-- Logs begin at Wed 2022-09-28 15:00:46 UTC, end at Wed 2022-09-28 16:01:47 UTC. -- Sep 28 15:32:59.903220 dv-cinder-859319-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 15:32:59.912327 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 15:32:59 2022] *** Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: nodename: dv-cinder-859319-2-iscsi Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: machine: x86_64 Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: clock source: unix Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: pcre jit disabled Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: detected number of CPU cores: 4 Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: current working directory: / Sep 28 15:32:59.915535 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: detected binary path: /usr/bin/uwsgi-core Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: your processes number limit is 47680 Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: your memory page size is 4096 bytes Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: detected max file descriptor number: 2048 Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: lock engine: pthread robust mutexes Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: thunder lock: enabled Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 15:32:59.916227 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 15:32:59.954365 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: Python main interpreter initialized at 0x55ef3284d9c0 Sep 28 15:32:59.954365 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: python threads support enabled Sep 28 15:32:59.954365 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: your server socket listen backlog is limited to 100 connections Sep 28 15:32:59.954365 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: your mercy for graceful operations on workers is 90 seconds Sep 28 15:32:59.954707 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 15:32:59.954787 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: *** Operational MODE: preforking *** Sep 28 15:32:59.955017 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: *** uWSGI is running in multiple interpreter mode *** Sep 28 15:32:59.955017 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: spawned uWSGI master process (pid: 112047) Sep 28 15:32:59.955199 dv-cinder-859319-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 15:32:59.956545 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: spawned uWSGI worker 1 (pid: 112048, cores: 1) Sep 28 15:32:59.956545 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: spawned uWSGI worker 2 (pid: 112049, cores: 1) Sep 28 15:32:59.956545 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 15:33:00.611698 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:33:00.616794 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:33:01.690705 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:33:01.690705 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: from cryptography.utils import int_from_bytes Sep 28 15:33:01.691326 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:33:01.691326 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: from cryptography.utils import int_from_bytes Sep 28 15:33:01.691445 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:33:01.691445 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: from cryptography.utils import int_from_bytes Sep 28 15:33:01.691823 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:33:01.691823 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: from cryptography.utils import int_from_bytes Sep 28 15:33:04.181898 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:33:04.182557 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:33:04.182921 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:33:04.183009 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:33:04.183088 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:33:04.183172 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:33:04.183263 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:33:04.183345 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:33:04.183433 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:33:04.183518 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:33:04.183603 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.183798 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.183903 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.184118 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.184206 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.184437 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.184530 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.184760 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.184847 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.185089 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.185182 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.185399 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.185493 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.185714 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.185809 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186049 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186136 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186317 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186619 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186703 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.186946 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187086 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-2-iscsi {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187246 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187340 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-2-iscsi {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187633 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187849 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.187933 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.188154 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.188248 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.188449 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.188540 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.188755 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.188900 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.189049 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.189184 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.189365 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.189540 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.189882 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190037 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190194 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190317 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190498 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190616 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190804 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.190979 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.191140 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.191318 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.191449 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.191532 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.191743 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.191838 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192061 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192153 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192366 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192453 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192666 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192754 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.192996 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.193090 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-2-iscsi {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.193395 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-2-iscsi {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.193492 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.193700 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.193785 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.194034 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.194132 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.194348 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.194433 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.194732 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.194837 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195035 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195129 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195349 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195433 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195674 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195808 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.195976 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.196086 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.196287 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.196385 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.196599 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.196692 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.196913 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197023 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197226 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197396 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197523 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197611 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197825 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.197974 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.198148 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.198251 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.198450 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.198541 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.198747 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.198836 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199046 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199142 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199291 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199387 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199580 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199663 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199884 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.199986 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.200196 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.200280 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.200511 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.200601 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.200754 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.200841 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201006 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201099 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201300 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201399 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201616 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201703 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.201942 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202035 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202245 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202340 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202544 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202631 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202844 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.202935 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.203143 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.203241 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.203440 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.203527 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.203738 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.203823 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204035 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204121 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204335 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204430 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204641 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204726 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.204956 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.205053 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.205257 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.205342 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.205564 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.205647 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.205900 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206015 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206220 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206306 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206521 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206607 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206830 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.206916 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.207151 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.207274 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.207452 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.207546 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.207766 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.207869 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.208076 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.208170 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.208376 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.208471 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.209195 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.209289 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.209496 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.209582 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.209798 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.209957 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210142 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210231 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210439 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210532 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210684 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210779 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.210985 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211078 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211283 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211368 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211586 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211682 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211881 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.211972 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.212182 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.212279 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.212481 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.212568 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.212773 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.212859 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213065 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213187 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213361 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213447 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213659 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213752 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.213980 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214079 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214279 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214379 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214578 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214662 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214871 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.214954 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.215168 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.215254 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.215467 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.215560 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.215763 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.215883 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216059 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216153 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216372 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216465 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216671 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216765 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.216967 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217052 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217262 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217382 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217560 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217654 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217899 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.217990 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.218180 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.218283 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.218478 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.218590 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.218776 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.218860 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219077 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219160 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219374 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219510 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219672 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219756 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.219970 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220054 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220268 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220363 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220566 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220658 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220857 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.220941 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.221159 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.221251 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.221460 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.221545 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.221757 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.221841 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222078 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222182 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222372 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222465 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222668 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222754 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.222964 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223049 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223261 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223353 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223553 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223646 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223847 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.223935 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.224137 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.224230 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.225425 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.225425 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.225425 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.225425 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226321 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226401 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226477 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226553 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226643 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226820 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.226913 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.227151 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.227244 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.227482 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.227574 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:33:04.227822 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.227907 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.228135 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.228219 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.228465 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.228553 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.228781 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.228868 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.229098 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.229184 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.229408 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.229495 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.229719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.229809 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.230054 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.230158 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.230364 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.230448 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.230673 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.230758 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231019 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231170 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231288 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231375 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231598 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231712 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.231918 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232018 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232232 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232317 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232550 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232635 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232861 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.232957 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.233167 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.233253 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.233478 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.233570 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.233788 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.233934 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.234130 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.234217 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.234436 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.234521 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.234758 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.234851 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.235067 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.235154 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.235410 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.235496 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.235734 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.235820 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.236055 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.236204 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.236372 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.236580 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.236737 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.236909 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237067 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237202 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237335 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237519 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237677 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237830 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.237996 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.238192 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.238339 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.238507 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.238669 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.238824 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.238966 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.239107 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.239249 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.239398 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.239540 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.239745 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.239903 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240038 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240163 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240351 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240502 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240664 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240803 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.240974 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.241109 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.241281 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.241428 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.241597 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.241722 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.241926 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.242127 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.242250 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.242603 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.242718 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.242857 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.243121 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.243214 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.243458 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.243544 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.243762 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244040 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244134 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244360 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244479 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244663 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244796 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.244986 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.245108 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.245311 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.245405 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.245616 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.245745 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.246224 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.246372 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.246532 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.246621 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.246841 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.246926 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.247150 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.247235 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.247458 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.247545 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.247760 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.247857 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248067 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248235 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248375 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248462 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248678 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248770 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.248986 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.249080 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.249291 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.249383 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.249589 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.249674 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.249916 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250018 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250224 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250308 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250521 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250606 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250830 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.250923 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.251135 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.251221 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.251435 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.251522 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.251741 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.251827 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252041 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252127 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252343 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252428 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252652 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252740 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.252956 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253039 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253260 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253346 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253567 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253654 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253890 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.253992 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.254213 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.254300 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.254521 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.254609 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.254826 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.254911 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.255129 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.255227 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.255438 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.255546 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.255762 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.255856 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256064 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256160 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256365 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256452 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256670 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256757 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.256970 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.257065 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.257271 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.257357 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.257567 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.257662 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.257880 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258013 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258184 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258282 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258487 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258582 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258788 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.258883 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259085 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259206 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259382 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259500 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259679 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259773 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.259974 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260060 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260291 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260594 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260681 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260889 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.260974 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.261187 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.261274 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.261485 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.261572 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.261826 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.261976 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.262149 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.262249 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.262458 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.262543 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.262765 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.262852 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.263073 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.263167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.263381 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.263466 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.263698 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.263785 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264007 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264101 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264312 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264397 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264616 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264700 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.264918 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265012 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265222 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265308 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265535 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265626 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265837 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.265956 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.266167 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.266251 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.266468 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.266553 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.266788 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.266876 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.267093 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.267180 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.267405 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.267490 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.267705 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.267802 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268013 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268100 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268335 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268427 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268646 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268733 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.268952 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269039 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269257 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269342 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269560 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269698 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269901 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.269993 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.270197 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.270285 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.273522 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.273675 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.273786 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.273911 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274038 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274157 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274271 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274376 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274479 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274581 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274684 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274795 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.274900 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275013 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275117 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275221 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275324 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275441 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275546 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275648 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275758 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275885 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.275981 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276070 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276150 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276236 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276315 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276392 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276483 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276563 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276680 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276775 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276856 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.276933 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277024 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277105 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277183 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277260 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277337 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277414 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277569 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277658 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277737 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277825 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.277935 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278037 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278119 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278203 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278282 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278360 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278437 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278522 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278723 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.278810 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279034 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279121 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279341 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279437 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279643 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279729 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.279943 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280067 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280247 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280346 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280562 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280649 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280863 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.280948 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.281165 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.281260 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.281467 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.281554 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.281768 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.281874 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.282093 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.282183 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.282413 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.282501 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.282714 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.282806 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283010 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283096 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283315 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283401 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283617 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283715 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.283927 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284013 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284235 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284320 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284531 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284616 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284841 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.284928 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.285149 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.285232 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.285451 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.285545 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.285757 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.285842 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.286086 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.286173 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.286389 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.286483 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.286701 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.286856 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.287654 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.287763 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.287902 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.287999 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.288206 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.288338 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.288513 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.288606 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.288815 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.288910 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.289119 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.289205 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.289433 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.289519 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.289757 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290035 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290152 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290368 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290481 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290703 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290838 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.290956 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.291061 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.291267 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.291380 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.291620 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.291836 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.291957 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.292166 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.292278 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.292479 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.292590 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.292793 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.292915 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.293141 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.293272 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.293441 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.293554 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.293743 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.293921 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.294076 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.294204 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.294818 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.294904 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.294983 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295072 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295153 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295232 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295310 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295387 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295541 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295638 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295841 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.295937 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.296137 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.296231 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.296436 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.296522 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.296735 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.296821 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297033 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297119 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297329 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297416 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297625 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297710 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.297944 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298047 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298245 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298333 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298546 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298640 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298844 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.298940 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.299141 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.299236 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.299437 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.299523 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.299754 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.299901 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300057 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300152 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300355 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300442 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300655 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300833 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.300957 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.301079 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.301295 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.301397 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.301593 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.301694 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.301921 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302011 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302226 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302316 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302551 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302653 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302858 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.302948 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.303164 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.303254 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.303464 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.303555 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.303770 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.303861 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304074 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304164 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304370 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304484 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304676 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304768 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.304975 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305061 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305273 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305362 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305570 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305663 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305886 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.305974 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.306193 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.306287 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.306492 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.306578 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.306788 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.306886 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307090 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307182 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307388 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307474 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307685 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307779 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.307986 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308070 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308282 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308374 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308577 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308671 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308879 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.308972 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.309176 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.309261 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.309471 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.309565 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.309773 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.309926 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310096 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310182 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310393 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310480 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310690 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310774 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.310987 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311088 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311287 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311385 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311581 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311667 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311881 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.311969 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.312178 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.312265 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.312478 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.312565 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.312783 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.312870 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.313083 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.313176 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.313380 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.313467 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.313681 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.313775 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314003 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314092 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314301 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314385 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314602 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314704 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314901 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.314990 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.315205 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.315291 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.315507 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.315602 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.315806 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.315890 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316103 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316197 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316398 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316492 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316693 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316779 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.316995 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.317093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.317291 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.317377 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.317586 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.317671 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.317900 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318009 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318226 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318314 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318527 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318612 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318845 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.318938 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.319147 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.319235 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.319445 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.319531 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.319743 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.319830 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320041 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320144 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320366 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320451 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320664 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320762 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.320969 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321054 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321267 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321409 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321578 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321673 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321903 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.321993 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.322211 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.322304 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.322507 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.322600 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.322806 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.322892 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.323107 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.323192 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.323418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.323512 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.323720 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.323813 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324028 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324114 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324329 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324431 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324760 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.324938 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325023 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325243 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325329 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325548 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325633 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325878 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.325967 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.326178 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.326266 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.326484 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.326570 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.326782 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.326866 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327086 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327173 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327390 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327691 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327776 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.327995 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328081 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328296 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328380 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328599 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328758 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328904 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.328991 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.329205 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.329291 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.329507 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.329601 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.329813 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.329931 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.330135 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.330227 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.330438 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.330536 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.330737 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.330822 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331036 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331133 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331333 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331428 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331644 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331760 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.331943 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332068 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332245 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332375 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332543 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332678 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332846 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.332985 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.333151 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.333290 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.334099 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.334195 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.334427 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.334514 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.334728 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.334863 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335033 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335154 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335341 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335449 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335648 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335745 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.335959 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336058 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336267 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336372 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336567 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336662 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336895 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.336998 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.337218 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.337344 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.337521 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.337615 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.337819 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.337929 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.338152 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.338255 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.338449 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.338538 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.338755 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.338853 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339070 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339168 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339367 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339462 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339667 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339782 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.339965 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.340084 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.340281 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.340497 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.340585 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.340803 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.340898 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.341109 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.341277 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.341431 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.341583 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.341753 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.341899 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.342101 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.342302 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.342392 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.342608 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.342695 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.342916 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343003 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343233 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343321 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343549 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343635 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343868 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.343955 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.344170 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.344258 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.344481 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.344574 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.344788 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.344884 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.345108 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.345207 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.345424 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.345522 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.345730 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.345834 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.346065 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.346155 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.346365 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.346455 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.346685 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.346790 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347003 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347101 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347312 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347402 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347627 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347726 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.347950 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348039 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348257 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348354 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348559 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348649 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348863 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.348954 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.349182 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.349928 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.350164 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.350267 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.350467 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.350561 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.350774 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.350861 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351073 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351167 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351374 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351459 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351680 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351833 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.351983 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.352119 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.352261 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.352401 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.352561 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.352707 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.352871 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353008 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353171 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353318 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353453 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353596 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353774 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.353931 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.354100 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.354246 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.354418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.354561 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.354722 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.354859 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355025 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355319 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355413 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355628 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355723 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.355946 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356035 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356248 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356349 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356546 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356641 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356846 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.356933 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.357147 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.357235 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.357485 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.357592 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.357788 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.357930 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.358126 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.358221 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.358441 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.358527 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.358759 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.358845 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359062 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359149 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359374 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359460 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359677 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359772 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.359985 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360080 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360297 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360393 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360590 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360685 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360893 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.360980 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.361190 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.361276 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.361489 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.361586 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.361790 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.361905 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.362112 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.362204 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.362412 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.362508 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.362712 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.362799 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363019 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363106 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363317 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363405 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363616 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363709 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.363913 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364008 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364216 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364303 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364609 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364860 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.364957 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.365176 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.365272 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.365477 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.365568 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.365780 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.365900 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.366108 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.366195 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.366425 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.366511 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.366737 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.366831 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367045 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367138 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367355 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367440 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367666 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367764 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.367976 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368063 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368278 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368372 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368585 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368720 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368895 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.368981 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.369202 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.369287 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.369513 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.369720 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.369816 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.370077 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.370166 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.370393 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.370497 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.370709 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.370796 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.371286 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.371376 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.371600 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.371797 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.371918 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.372118 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.372218 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.372430 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.372517 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.372739 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.372828 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373050 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373138 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373359 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373467 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373667 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373754 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.373995 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.374086 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.374302 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.374401 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.374613 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.374722 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.374920 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375014 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375243 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375347 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375560 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375652 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375881 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.375972 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.376212 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.376331 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.376524 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.376611 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.376832 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.376918 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.377143 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.377230 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.377451 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.377538 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.377756 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.377900 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.378087 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.378177 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.378401 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.378489 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.378711 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.378806 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379018 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379105 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379326 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379630 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379724 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.379936 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380023 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380246 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380341 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380596 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380687 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380903 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.380992 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.381209 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.381297 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.381518 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.381606 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.381827 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.381979 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.382169 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.382369 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.382499 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.382683 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.382819 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383016 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383129 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383342 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383432 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383662 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383749 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.383979 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.384235 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.384338 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.384545 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.384632 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.384873 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.384959 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.385178 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.385275 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.385486 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.385634 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.385790 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.385911 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.386120 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.386209 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.386439 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.386525 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.386741 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.386829 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387041 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387129 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387343 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387435 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387649 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387735 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.387949 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.388174 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.388264 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.388521 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.388609 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.388835 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.388931 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.389147 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.389258 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.389450 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.389538 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.389767 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.389995 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.390085 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.390339 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.390426 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.390652 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.390749 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.390974 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391061 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391284 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391369 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391594 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391689 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391895 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.391980 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.392197 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.392291 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.392503 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.392597 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.392806 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.392890 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.393105 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.393192 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.393409 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.393496 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.393707 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.393793 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394031 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394118 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394337 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394426 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394637 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394729 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.394932 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395024 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395236 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395322 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395530 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395833 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.395919 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.396645 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.396746 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.396944 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397032 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397253 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397356 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397553 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397639 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397871 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.397963 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.398176 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.398275 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.398477 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.398564 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.398776 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.398872 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399082 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399183 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399381 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399467 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399685 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399772 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.399984 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.400081 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.400287 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.400374 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.400630 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.400714 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.400933 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401029 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401231 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401318 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401547 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401633 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401859 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.401949 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.402164 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.402296 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.402475 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.402574 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.402784 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.403024 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.403112 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.403357 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.403444 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.403675 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.403770 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404007 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404102 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404314 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404400 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404630 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404839 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.404926 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.405172 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.405259 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.405488 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.405583 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.405816 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.405966 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.406149 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.406243 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.406457 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.406551 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.406759 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.406847 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407063 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407149 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407370 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407466 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407674 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407760 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.407978 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408071 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408282 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408375 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408586 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408679 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408886 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.408972 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.409190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.409284 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.409493 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.409579 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.409795 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.409910 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.410122 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.410210 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.410428 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.410516 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.410733 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.410829 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.411038 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.411133 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.411342 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.411429 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.411647 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.411807 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.412502 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.412590 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.412811 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.412905 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.413116 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.413280 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.413423 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.413511 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.413735 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.413822 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.414087 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.414178 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.414398 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.414486 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.414701 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.414789 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.415023 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.415327 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.415454 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.415637 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.415725 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.415962 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.416058 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.416273 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.416359 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.416573 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.416659 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.416894 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.417216 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.417302 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.417526 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.417612 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.417866 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.417968 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.418178 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.418263 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.418487 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.418581 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.418812 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.418909 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.419134 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.419221 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.419444 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.419530 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.419745 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.419832 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420049 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420135 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420352 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420443 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420659 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420746 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.420974 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421072 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421281 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421372 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421582 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421669 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421904 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.421996 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.422207 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.422294 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.422505 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.422592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.422806 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.422892 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.423108 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.423203 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.423404 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.423497 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.423706 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.423799 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424002 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424097 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424299 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424385 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424595 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424687 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424894 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.424993 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.425191 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.425276 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.425487 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.425571 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.425782 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.425920 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.426109 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.426197 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.426408 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.426502 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.426707 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.426794 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427006 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427304 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427409 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427647 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427734 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.427947 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428034 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428251 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428337 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428549 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428643 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428849 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.428935 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.429147 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.429240 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.429474 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.429562 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.429792 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.429911 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.430130 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.430233 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.430504 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.430812 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.431144 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.431452 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.431762 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.432134 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.432382 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.432690 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.432831 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.432998 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.433157 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.433323 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.433487 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.433646 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.433801 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.433985 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.434161 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.434311 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.434625 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.434713 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.434944 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.435229 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.435325 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.435554 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.435799 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.435889 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.436184 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.436415 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.436515 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.436788 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.436994 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.437080 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.437392 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.437540 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.437707 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.438132 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.438223 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.438657 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.438743 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.439154 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.439311 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.439479 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.439809 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.439895 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.440140 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.440389 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.440486 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.440830 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.440965 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.441159 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.441294 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.441506 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.441711 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.441819 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.442073 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.442210 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.442456 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.442544 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.442844 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.443459 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.443673 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.443871 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.443968 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.444211 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:33:04.444296 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.444531 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.444852 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.445314 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.445706 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.446082 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.446455 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.446800 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.447117 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.447441 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.447760 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.448092 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.448423 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.448737 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.449311 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.449987 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.450601 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.451155 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.451518 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.451854 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.452173 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.452490 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.452799 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:33:04.453095 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112048) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:33:04.597049 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO dbcounter [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Registered counter for database nova_api Sep 28 15:33:04.606298 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO dbcounter [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Registered counter for database nova_api Sep 28 15:33:04.617395 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_db.sqlalchemy.engines [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.624189 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writer thread running {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.625812 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_db.sqlalchemy.engines [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.632774 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writer thread running {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.680884 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.context [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9312f5f-55a4-4294-b434-e057139feeb0(cell1) {{(pid=112049) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:33:04.684820 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_concurrency.lockutils [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:33:04.685242 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_concurrency.lockutils [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:33:04.686822 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_concurrency.lockutils [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:33:04.687541 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_concurrency.lockutils [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:33:04.687981 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_concurrency.lockutils [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:33:04.689003 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.context [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9312f5f-55a4-4294-b434-e057139feeb0(cell1) {{(pid=112048) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:33:04.689998 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_concurrency.lockutils [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:33:04.691983 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO dbcounter [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Registered counter for database nova_cell0 Sep 28 15:33:04.692837 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:33:04.693885 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:33:04.695421 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:33:04.696134 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:33:04.696504 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO dbcounter [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Registered counter for database nova_cell1 Sep 28 15:33:04.696614 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:33:04.698544 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:33:04.700521 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO dbcounter [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Registered counter for database nova_cell0 Sep 28 15:33:04.704171 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_db.sqlalchemy.engines [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.704580 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO dbcounter [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Registered counter for database nova_cell1 Sep 28 15:33:04.705842 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_db.sqlalchemy.engines [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.712228 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_db.sqlalchemy.engines [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.712652 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writer thread running {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.714721 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writer thread running {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.715708 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_db.sqlalchemy.engines [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.717677 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writer thread running {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.856882 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writer thread running {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.859443 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO dbcounter [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Registered counter for database nova_cell0 Sep 28 15:33:04.865671 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO dbcounter [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Registered counter for database nova_cell0 Sep 28 15:33:04.866582 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG oslo_db.sqlalchemy.engines [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.871244 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writer thread running {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:04.874385 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_db.sqlalchemy.engines [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112048) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:33:04.878956 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writer thread running {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:33:05.206858 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: WARNING keystonemiddleware.auth_token [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:33:05.211180 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: WARNING keystonemiddleware.auth_token [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:33:05.214839 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: WARNING keystonemiddleware.auth_token [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:33:05.218381 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: WARNING keystonemiddleware.auth_token [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:33:05.557142 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: WARNING keystonemiddleware.auth_token [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:33:05.563139 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: WARNING keystonemiddleware.auth_token [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:33:05.568040 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: WARNING keystonemiddleware.auth_token [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:33:05.568465 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef3284d9c0 pid: 112048 (default app) Sep 28 15:33:05.570554 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:33:05.571741 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Sep 28 15:33:05.572145 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Sep 28 15:33:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:33:05.574196 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: WARNING keystonemiddleware.auth_token [None req-765aa7d9-a3fd-4960-a1db-86558f9360e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:33:05.579526 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef3284d9c0 pid: 112049 (default app) Sep 28 15:34:27.290385 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:27.292140 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002289 Sep 28 15:34:27.292758 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:27.310628 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_api:SELECT=3 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:27.311792 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_cell1:SELECT=3 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:27.312686 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_cell0:SELECT=3 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:27.313534 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:28.200987 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-d2ba324e-74a1-4cd5-82dc-53386cf6d0ff admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:28.234578 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-d2ba324e-74a1-4cd5-82dc-53386cf6d0ff admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933923 Sep 28 15:34:28.235382 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 15:34:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:30.839850 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:30.840862 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-89cf75e6-93b5-4844-878d-e298e1de5f48 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Sep 28 15:34:30.841398 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:31.294566 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-f7f5d83a-da43-4921-aa62-84b82373f1e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:31.345238 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-f7f5d83a-da43-4921-aa62-84b82373f1e4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497899 Sep 28 15:34:31.345799 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:34:31.359415 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_api:SELECT=3 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:31.365392 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_cell0:SELECT=3 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:31.366273 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_cell1:SELECT=3 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:31.367146 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:34:31.570851 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-6461c260-e2fe-4469-8ccb-9581ed3fa920 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:31.639216 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-6461c260-e2fe-4469-8ccb-9581ed3fa920 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284850 Sep 28 15:34:31.639875 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 15:34:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:34.257376 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-f7f5d83a-da43-4921-aa62-84b82373f1e4 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:34.258349 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-f7f5d83a-da43-4921-aa62-84b82373f1e4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 28 15:34:34.258748 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:34.915718 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-ee0270e4-1a96-4c0a-b67e-92ef7e00a877 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:34.961184 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-ee0270e4-1a96-4c0a-b67e-92ef7e00a877 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.695505 Sep 28 15:34:34.965818 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:34:34.975528 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-785ec833-ccdd-4d51-a26d-31ce944f345e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:35.018933 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-785ec833-ccdd-4d51-a26d-31ce944f345e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047280 Sep 28 15:34:35.019526 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 15:34:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:37.634754 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-ee0270e4-1a96-4c0a-b67e-92ef7e00a877 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:37.635754 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-ee0270e4-1a96-4c0a-b67e-92ef7e00a877 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 28 15:34:37.636157 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:38.177477 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9e415537-808e-42c8-8b02-7b03e1eac420 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:38.198562 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9e415537-808e-42c8-8b02-7b03e1eac420 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556061 Sep 28 15:34:38.199116 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:34:38.213606 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-fefa1245-63bb-4b7f-b49d-71521b08bced admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:38.242995 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-fefa1245-63bb-4b7f-b49d-71521b08bced admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034117 Sep 28 15:34:38.243567 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 15:34:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:40.851673 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9e415537-808e-42c8-8b02-7b03e1eac420 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:40.852705 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9e415537-808e-42c8-8b02-7b03e1eac420 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 28 15:34:40.853189 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:41.294163 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-d78cfde8-00c6-444d-8024-7ec9769afbdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:41.318482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-d78cfde8-00c6-444d-8024-7ec9769afbdd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459037 Sep 28 15:34:41.320226 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:34:41.331801 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-b0bad0dd-8be1-4374-a8dc-00091918e9f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:41.365754 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-b0bad0dd-8be1-4374-a8dc-00091918e9f2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037536 Sep 28 15:34:41.366379 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 15:34:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:44.014155 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-d78cfde8-00c6-444d-8024-7ec9769afbdd admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:44.015240 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-d78cfde8-00c6-444d-8024-7ec9769afbdd admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Sep 28 15:34:44.015659 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:44.440366 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-5d11d986-2c83-4d17-a40b-17d0875a130c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:44.459368 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-5d11d986-2c83-4d17-a40b-17d0875a130c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437526 Sep 28 15:34:44.459967 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:34:44.471964 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-791dbc06-10d0-49e5-a7a4-1d025fde4421 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:44.498991 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-791dbc06-10d0-49e5-a7a4-1d025fde4421 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030507 Sep 28 15:34:44.499718 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 15:34:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:47.101361 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-5d11d986-2c83-4d17-a40b-17d0875a130c admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:47.102729 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-5d11d986-2c83-4d17-a40b-17d0875a130c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Sep 28 15:34:47.103328 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:47.561277 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-a0be8792-36e7-4446-b694-36bdf91d10e9 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:47.586577 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-a0be8792-36e7-4446-b694-36bdf91d10e9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476637 Sep 28 15:34:47.587117 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 15:34:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:34:50.173831 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-5d11d986-2c83-4d17-a40b-17d0875a130c admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:50.174871 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-5d11d986-2c83-4d17-a40b-17d0875a130c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 28 15:34:50.175266 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:50.567465 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-665b62e1-8630-4f8d-8514-308c597533dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:50.588511 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-665b62e1-8630-4f8d-8514-308c597533dc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.407134 Sep 28 15:34:50.589070 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:34:50.601032 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-62e402f5-5392-4654-93a6-9cd7bbcbe1f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:50.628365 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-62e402f5-5392-4654-93a6-9cd7bbcbe1f3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031026 Sep 28 15:34:50.628923 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 15:34:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:34:53.218529 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-665b62e1-8630-4f8d-8514-308c597533dc admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:53.219575 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-665b62e1-8630-4f8d-8514-308c597533dc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 28 15:34:53.219961 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:53.613055 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-be8c2418-1725-4f4e-9a37-6f86dea5c0c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 2048, "vcpus": 1}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:53.635097 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-be8c2418-1725-4f4e-9a37-6f86dea5c0c2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408805 Sep 28 15:34:53.635661 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:34:53.648101 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-82be8d2a-0db9-4e65-a91e-09dc9fd6b754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:53.671798 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-82be8d2a-0db9-4e65-a91e-09dc9fd6b754 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027447 Sep 28 15:34:53.672872 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 15:34:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:34:56.288133 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-be8c2418-1725-4f4e-9a37-6f86dea5c0c2 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:56.289911 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-be8c2418-1725-4f4e-9a37-6f86dea5c0c2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Sep 28 15:34:56.296453 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:34:56.770986 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-f73473fc-09f2-4e4f-b4ca-c6cb6e2bf00a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "swap": 0}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:56.792436 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-f73473fc-09f2-4e4f-b4ca-c6cb6e2bf00a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.495136 Sep 28 15:34:56.793795 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:34:56.805714 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-17073353-cfc2-4142-a836-0cc9b81a1989 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:34:56.835355 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-17073353-cfc2-4142-a836-0cc9b81a1989 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033342 Sep 28 15:34:56.835936 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 15:34:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:34:59.543664 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-f73473fc-09f2-4e4f-b4ca-c6cb6e2bf00a admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:34:59.545288 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-f73473fc-09f2-4e4f-b4ca-c6cb6e2bf00a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Sep 28 15:34:59.545686 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:34:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:00.002415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-be0fd0d7-c3d4-4d8e-b553-d7dede94eb21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "id": "4", "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:00.009335 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:00.028180 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-be0fd0d7-c3d4-4d8e-b553-d7dede94eb21 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475919 Sep 28 15:35:00.029032 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:34:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:00.040876 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-9d8cd959-9b50-4cef-86f8-44b98e35771a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:00.065968 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-9d8cd959-9b50-4cef-86f8-44b98e35771a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028535 Sep 28 15:35:00.066728 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 15:35:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:35:02.702461 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-be0fd0d7-c3d4-4d8e-b553-d7dede94eb21 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:02.703745 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-be0fd0d7-c3d4-4d8e-b553-d7dede94eb21 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Sep 28 15:35:02.704246 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:03.181350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-32e9dae2-cdef-4382-931c-c16d71c51679 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:03.189122 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:03.207182 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-32e9dae2-cdef-4382-931c-c16d71c51679 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496391 Sep 28 15:35:03.209893 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 15:35:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:03.221162 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9af163bc-d239-43a7-a958-1dadc135d818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:03.250732 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9af163bc-d239-43a7-a958-1dadc135d818 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034157 Sep 28 15:35:03.258054 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 15:35:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:35:20.180970 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-32e9dae2-cdef-4382-931c-c16d71c51679 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:20.181999 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-32e9dae2-cdef-4382-931c-c16d71c51679 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 28 15:35:20.182408 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:35:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:20.193375 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:35:20.574978 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-b1ca38a4-52f5-4eac-8573-6608f1c6cb93 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:20.593194 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-b1ca38a4-52f5-4eac-8573-6608f1c6cb93 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404870 Sep 28 15:35:20.593722 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 15:35:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:35:21.910066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-32e9dae2-cdef-4382-931c-c16d71c51679 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:21.911075 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-32e9dae2-cdef-4382-931c-c16d71c51679 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 28 15:35:21.911495 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:22.451019 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-19fca45e-49fb-47cf-9557-3bedb1e01c1f admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:22.456925 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.wsgi [None req-19fca45e-49fb-47cf-9557-3bedb1e01c1f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-19fca45e-49fb-47cf-9557-3bedb1e01c1f admin admin] Request method failure captured: Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Accept: application/json Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Accept-Encoding: gzip, deflate Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Connection: keep-alive Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Content-Length: 0 Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Host: 10.222.0.52 Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Openstack-Api-Version: compute 2.92 Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Openstack-System-Scope: None Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: User-Agent: python-novaclient Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Auth-Token: gAAAAABjNGm5PwpiCHrpNKgmNLbLg-peJhbn8oyO6NYk1WtnOdZjDR1GCxgHB-6ZCtyDLaKEbXXalktqbJPrKiHAx5JMLGkowtD1QyHFGVUHoTCK3zdcuJloJpbpcdmW6Z8ZEJ6EVUjyVjm9xKG7BPOGPxExO70RAOIjkPwnzk5gLTyGce6c1lw Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Domain-Id: None Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Domain-Name: None Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Identity-Status: Confirmed Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Is-Admin-Project: True Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Domain-Id: default Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Domain-Name: Default Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Name: admin Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Role: admin,reader,member Sep 28 15:35:22.460190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Roles: admin,reader,member Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8de950cb25d34fe8afed2528d2e112e6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant: admin Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant-Name: admin Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User: admin Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Domain-Id: default Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Domain-Name: Default Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Id: 0fdbcf7ba1534603b18de5dbaf96574f Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Name: admin Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: method: > Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: exception: Flavor 42 could not be found. Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: action_args: {'id': '42'} Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:35:22.461588 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:22.466415 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.467739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-19fca45e-49fb-47cf-9557-3bedb1e01c1f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:35:22.468993 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-19fca45e-49fb-47cf-9557-3bedb1e01c1f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393607 Sep 28 15:35:22.468993 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 15:35:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:35:22.472339 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-b280095d-16d4-4f14-8bff-ac01baa27d0f admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:22.494907 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-b280095d-16d4-4f14-8bff-ac01baa27d0f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026589 Sep 28 15:35:22.495440 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 15:35:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:35:22.506911 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-0bf0bf7e-c06b-4f67-948f-5769b35a1619 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:22.528825 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-0bf0bf7e-c06b-4f67-948f-5769b35a1619 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026367 Sep 28 15:35:22.529353 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 15:35:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:35:22.538685 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-09d64bd7-6bd4-4316-816a-357d9dc87b6d admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:22.544068 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.wsgi [None req-09d64bd7-6bd4-4316-816a-357d9dc87b6d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-09d64bd7-6bd4-4316-816a-357d9dc87b6d admin admin] Request method failure captured: Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Accept: application/json Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Accept-Encoding: gzip, deflate Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Connection: keep-alive Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Content-Length: 0 Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Host: 10.222.0.52 Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Openstack-Api-Version: compute 2.92 Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Openstack-System-Scope: None Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: User-Agent: python-novaclient Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Auth-Token: gAAAAABjNGm5PwpiCHrpNKgmNLbLg-peJhbn8oyO6NYk1WtnOdZjDR1GCxgHB-6ZCtyDLaKEbXXalktqbJPrKiHAx5JMLGkowtD1QyHFGVUHoTCK3zdcuJloJpbpcdmW6Z8ZEJ6EVUjyVjm9xKG7BPOGPxExO70RAOIjkPwnzk5gLTyGce6c1lw Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Domain-Id: None Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Domain-Name: None Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Identity-Status: Confirmed Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Is-Admin-Project: True Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Domain-Id: default Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Domain-Name: Default Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Name: admin Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Role: admin,reader,member Sep 28 15:35:22.547482 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Roles: admin,reader,member Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8de950cb25d34fe8afed2528d2e112e6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant: admin Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant-Name: admin Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User: admin Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Domain-Id: default Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Domain-Name: Default Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Id: 0fdbcf7ba1534603b18de5dbaf96574f Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Name: admin Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: method: > Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: exception: Flavor 42 could not be found. Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: action_args: {'id': '42'} Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:35:22.549350 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:22.550331 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:22.551420 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-09d64bd7-6bd4-4316-816a-357d9dc87b6d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:35:22.552431 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-09d64bd7-6bd4-4316-816a-357d9dc87b6d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013788 Sep 28 15:35:22.552431 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 15:35:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:35:23.764264 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-0bf0bf7e-c06b-4f67-948f-5769b35a1619 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:23.765305 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-0bf0bf7e-c06b-4f67-948f-5769b35a1619 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 28 15:35:23.765702 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:24.290544 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-4b8b8cda-3797-467c-b634-66f483e17cca admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:24.295863 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.wsgi [None req-4b8b8cda-3797-467c-b634-66f483e17cca admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-4b8b8cda-3797-467c-b634-66f483e17cca admin admin] Request method failure captured: Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Accept: application/json Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Accept-Encoding: gzip, deflate Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Connection: keep-alive Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Content-Length: 0 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Host: 10.222.0.52 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Openstack-Api-Version: compute 2.92 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Openstack-System-Scope: None Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: User-Agent: python-novaclient Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Auth-Token: gAAAAABjNGm7rOKPdMCAYr1ne8vIBa0pPD7rr6VY01wKYvvwfZBTPLLqaLx2UKwvAUwqo9RcUCAnxKl05w_ZFtVpG-8lCzjcrMr5EQud01BVGfTXiIl3zpa1YIacraH8jnEYYMQ63p7ybBfINSPU8qnXxXJ543vIqFkSDgu_DXwGpnHFgo7All4 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Domain-Id: None Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Domain-Name: None Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Identity-Status: Confirmed Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Is-Admin-Project: True Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Domain-Id: default Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Domain-Name: Default Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Name: admin Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Role: admin,reader,member Sep 28 15:35:24.297167 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Roles: admin,reader,member Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8de950cb25d34fe8afed2528d2e112e6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant: admin Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant-Name: admin Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User: admin Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Domain-Id: default Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Domain-Name: Default Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Id: 0fdbcf7ba1534603b18de5dbaf96574f Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Name: admin Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: method: > Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: exception: Flavor 84 could not be found. Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: action_args: {'id': '84'} Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:35:24.298897 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:24.299972 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.301629 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-4b8b8cda-3797-467c-b634-66f483e17cca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:35:24.302942 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-4b8b8cda-3797-467c-b634-66f483e17cca admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392097 Sep 28 15:35:24.302942 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 15:35:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:35:24.308336 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-ee0492e6-6d72-46aa-b83e-4b20406bf652 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:24.323958 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-ee0492e6-6d72-46aa-b83e-4b20406bf652 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019103 Sep 28 15:35:24.324554 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 15:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:35:24.335177 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-49213372-756b-4054-bee7-8f8af5f16e91 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:24.352193 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-49213372-756b-4054-bee7-8f8af5f16e91 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021045 Sep 28 15:35:24.353017 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 15:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:35:24.363206 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-d199d74c-8bac-4270-b24f-e154b7c91273 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:24.368257 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.wsgi [None req-d199d74c-8bac-4270-b24f-e154b7c91273 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-d199d74c-8bac-4270-b24f-e154b7c91273 admin admin] Request method failure captured: Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Accept: application/json Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Accept-Encoding: gzip, deflate Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Connection: keep-alive Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Content-Length: 0 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Host: 10.222.0.52 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Openstack-Api-Version: compute 2.92 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Openstack-System-Scope: None Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: User-Agent: python-novaclient Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Auth-Token: gAAAAABjNGm7rOKPdMCAYr1ne8vIBa0pPD7rr6VY01wKYvvwfZBTPLLqaLx2UKwvAUwqo9RcUCAnxKl05w_ZFtVpG-8lCzjcrMr5EQud01BVGfTXiIl3zpa1YIacraH8jnEYYMQ63p7ybBfINSPU8qnXxXJ543vIqFkSDgu_DXwGpnHFgo7All4 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Domain-Id: None Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Domain-Name: None Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Identity-Status: Confirmed Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Is-Admin-Project: True Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Domain-Id: default Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Domain-Name: Default Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Name: admin Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Role: admin,reader,member Sep 28 15:35:24.369739 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Roles: admin,reader,member Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8de950cb25d34fe8afed2528d2e112e6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant: admin Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant-Name: admin Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User: admin Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Domain-Id: default Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Domain-Name: Default Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Id: 0fdbcf7ba1534603b18de5dbaf96574f Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Name: admin Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: method: > Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: exception: Flavor 84 could not be found. Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: action_args: {'id': '84'} Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:35:24.371378 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:24.372719 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:24.374222 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-d199d74c-8bac-4270-b24f-e154b7c91273 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:35:24.375544 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-d199d74c-8bac-4270-b24f-e154b7c91273 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012022 Sep 28 15:35:24.375544 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 15:35:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 28 15:35:25.579214 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-49213372-756b-4054-bee7-8f8af5f16e91 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:25.580719 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-49213372-756b-4054-bee7-8f8af5f16e91 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001915 Sep 28 15:35:25.581108 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:26.097809 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9e8c6605-59a6-4bac-9059-6839969d672f admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:26.103609 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.wsgi [None req-9e8c6605-59a6-4bac-9059-6839969d672f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9e8c6605-59a6-4bac-9059-6839969d672f admin admin] Request method failure captured: Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Accept: application/json Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Accept-Encoding: gzip, deflate Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Connection: keep-alive Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Content-Length: 0 Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Host: 10.222.0.52 Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Openstack-Api-Version: compute 2.92 Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Openstack-System-Scope: None Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: User-Agent: python-novaclient Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Auth-Token: gAAAAABjNGm9SQBpJtPOlH55M2NkapQNm9weWs8fYLexHDBwTjKiXcg7m2Jrbf-0O9aEHyYZxl-bnv_C1gWP4Ny3u3FNyIogVmLXK8GFONztLjdXgG_euue0fVenIwaYWD4fF6FxjC82Nj_RtoZ03_GFitlEQCojY2zhHm70AUPUwEE4XNtNqXs Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Domain-Id: None Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Domain-Name: None Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Identity-Status: Confirmed Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Is-Admin-Project: True Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Domain-Id: default Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Domain-Name: Default Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Project-Name: admin Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Role: admin,reader,member Sep 28 15:35:26.105093 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Roles: admin,reader,member Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8de950cb25d34fe8afed2528d2e112e6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant: admin Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-Tenant-Name: admin Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User: admin Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Domain-Id: default Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Domain-Name: Default Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Id: 0fdbcf7ba1534603b18de5dbaf96574f Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: X-User-Name: admin Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: method: > Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: exception: Flavor 451 could not be found. Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: action_args: {'id': '451'} Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:35:26.106621 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:26.107418 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.108448 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9e8c6605-59a6-4bac-9059-6839969d672f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:35:26.109440 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9e8c6605-59a6-4bac-9059-6839969d672f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388729 Sep 28 15:35:26.109440 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 15:35:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:35:26.116193 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-d3d9f762-c5bf-49f8-9a7d-a9b97c6b09b1 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:26.131668 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-d3d9f762-c5bf-49f8-9a7d-a9b97c6b09b1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019006 Sep 28 15:35:26.132190 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 15:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:35:26.141313 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:26.156299 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018440 Sep 28 15:35:26.156814 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 15:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:35:26.165673 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-99f4091a-5615-4dfc-86c0-3016edc0b851 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:26.170569 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.wsgi [None req-99f4091a-5615-4dfc-86c0-3016edc0b851 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-99f4091a-5615-4dfc-86c0-3016edc0b851 admin admin] Request method failure captured: Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Accept: application/json Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Accept-Encoding: gzip, deflate Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Connection: keep-alive Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Content-Length: 0 Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Host: 10.222.0.52 Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Openstack-Api-Version: compute 2.92 Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Openstack-System-Scope: None Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: User-Agent: python-novaclient Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Auth-Token: gAAAAABjNGm9SQBpJtPOlH55M2NkapQNm9weWs8fYLexHDBwTjKiXcg7m2Jrbf-0O9aEHyYZxl-bnv_C1gWP4Ny3u3FNyIogVmLXK8GFONztLjdXgG_euue0fVenIwaYWD4fF6FxjC82Nj_RtoZ03_GFitlEQCojY2zhHm70AUPUwEE4XNtNqXs Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Domain-Id: None Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Domain-Name: None Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Identity-Status: Confirmed Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Is-Admin-Project: True Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Domain-Id: default Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Domain-Name: Default Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Project-Name: admin Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Role: admin,reader,member Sep 28 15:35:26.172066 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Roles: admin,reader,member Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8de950cb25d34fe8afed2528d2e112e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8de950cb25d34fe8afed2528d2e112e6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant: admin Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant-Id: 8de950cb25d34fe8afed2528d2e112e6 Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-Tenant-Name: admin Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User: admin Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Domain-Id: default Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Domain-Name: Default Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Id: 0fdbcf7ba1534603b18de5dbaf96574f Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: X-User-Name: admin Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: method: > Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: exception: Flavor 451 could not be found. Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: action_args: {'id': '451'} Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:35:26.173592 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:26.174516 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: ERROR nova.api.openstack.wsgi Sep 28 15:35:26.175548 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-99f4091a-5615-4dfc-86c0-3016edc0b851 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112048) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:35:26.176530 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-99f4091a-5615-4dfc-86c0-3016edc0b851 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011191 Sep 28 15:35:26.176530 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 15:35:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 15:35:27.407933 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:27.409029 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001842 Sep 28 15:35:27.409420 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:27.933419 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-c934ae6b-182b-45da-b070-00c0b42b9b98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:27.953842 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-c934ae6b-182b-45da-b070-00c0b42b9b98 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405624 Sep 28 15:35:27.954402 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 15:35:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:35:29.178273 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:29.179265 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 28 15:35:29.179661 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:29.705703 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-a3bd398b-fd1f-4438-8eba-fbfeda079add admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:29.724643 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-a3bd398b-fd1f-4438-8eba-fbfeda079add admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405376 Sep 28 15:35:29.725183 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 15:35:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:30.945889 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:30.946870 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 28 15:35:30.947264 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:31.463239 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-6a86ce57-7e04-4f06-8f31-894549678883 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:31.483111 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-6a86ce57-7e04-4f06-8f31-894549678883 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.399604 Sep 28 15:35:31.483711 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 15:35:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:32.692264 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:32.693267 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 28 15:35:32.693662 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:33.214364 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-63d2c6b7-e7f5-440b-b606-0e30a1281bf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:35:33.234199 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-63d2c6b7-e7f5-440b-b606-0e30a1281bf6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405130 Sep 28 15:35:33.234743 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 15:35:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:35:34.445658 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:34.446685 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 28 15:35:34.447082 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:35:34.963059 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-7bfdb7c7-3f43-4d56-a219-4f2af34f9aff admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:35:34.982920 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-7bfdb7c7-3f43-4d56-a219-4f2af34f9aff admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398885 Sep 28 15:35:34.983451 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Sep 28 15:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:31.597755 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:31.598792 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-c9880eba-8c44-4e0d-ac76-77598b50d0d5 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 28 15:36:31.599190 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 15:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:36:31.609577 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:36:31.983843 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-61efbbfc-63c1-4f36-a88a-929576618442 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.004391 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-61efbbfc-63c1-4f36-a88a-929576618442 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399238 Sep 28 15:36:32.004922 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 15:36:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:36:32.029223 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_api:SELECT=14 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:36:32.033496 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-8e64591f-edeb-4246-a2ee-0934cdb73ace admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.040747 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-8e64591f-edeb-4246-a2ee-0934cdb73ace admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013001 Sep 28 15:36:32.041258 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Sep 28 15:36:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:32.053194 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-78d0934b-54f0-451f-808d-ce8db6f3a611 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.060436 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-78d0934b-54f0-451f-808d-ce8db6f3a611 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011285 Sep 28 15:36:32.060938 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Sep 28 15:36:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:32.073819 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.081080 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011781 Sep 28 15:36:32.081598 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Sep 28 15:36:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:36:32.092868 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-f13e1e0f-ad04-4f2d-9a2d-593362a1eaca admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:36:32.100498 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-f13e1e0f-ad04-4f2d-9a2d-593362a1eaca admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011132 Sep 28 15:36:32.101009 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Sep 28 15:36:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:39:29.923472 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:29.924482 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 28 15:39:29.924876 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:39:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:39:30.066144 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_api:SELECT=6 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:39:30.231535 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:30.236379 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:30.236941 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:30.237437 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:30.238243 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:30.238691 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:30.239106 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:30.271553 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-69812bb7-b5dd-4a1f-8aa0-9f78fbb243d1 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.206298 Sep 28 15:39:30.271855 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 15:39:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:39:31.346157 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:31.347159 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 28 15:39:31.347553 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:39:31.538369 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:31.541747 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:31.542285 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:31.542709 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:31.543417 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:31.543859 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:31.544271 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:31.564619 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-21cbe435-931b-4c6a-86a4-adcd58bfc801 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078683 Sep 28 15:39:31.565272 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 15:39:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:39:43.032960 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:43.034011 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 28 15:39:43.034425 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:39:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:39:43.176745 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_cell0:SELECT=4 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:39:43.177463 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_cell1:SELECT=4 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:39:43.178136 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG dbcounter [-] [112048] Writing DB stats nova_api:SELECT=8 {{(pid=112048) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:39:43.225221 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:43.228647 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:43.229125 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:43.229553 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:43.230352 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:43.230828 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:43.231242 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:43.256913 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-1567ca62-78de-4274-92a0-1170aa2b254b admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084568 Sep 28 15:39:43.257392 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 15:39:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:39:44.331441 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG nova.api.openstack.wsgi [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] Calling method '>' {{(pid=112049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:44.332440 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: INFO nova.api.openstack.requestlog [None req-9994069e-fd44-4689-bc2e-1bcab30582cf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Sep 28 15:39:44.332831 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: [pid: 112049|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 15:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:39:44.519946 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG nova.api.openstack.wsgi [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Calling method '>' {{(pid=112048) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:39:44.523299 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:44.523768 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:44.524188 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:44.524885 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:39:44.525320 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:39:44.525724 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: DEBUG oslo_concurrency.lockutils [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112048) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:39:44.548789 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: INFO nova.api.openstack.requestlog [None req-e6581d46-d867-4661-bf56-dc4deb0aaaa0 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079115 Sep 28 15:39:44.549495 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: [pid: 112048|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 15:39:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:40:41.479194 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: Wed Sep 28 15:40:41 2022 - graceful shutdown triggered... Sep 28 15:40:41.478976 dv-cinder-859319-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 28 15:40:41.480162 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: Gracefully killing worker 2 (pid: 112049)... Sep 28 15:40:41.480521 dv-cinder-859319-2-iscsi devstack@n-api.service[112048]: Gracefully killing worker 1 (pid: 112048)... Sep 28 15:40:41.605485 dv-cinder-859319-2-iscsi devstack@n-api.service[112049]: DEBUG dbcounter [-] [112049] Writing DB stats nova_api:SELECT=4 {{(pid=112049) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:40:42.479990 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: worker 1 buried after 1 seconds Sep 28 15:40:42.479990 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: worker 2 buried after 1 seconds Sep 28 15:40:42.479990 dv-cinder-859319-2-iscsi devstack@n-api.service[112047]: goodbye to uWSGI. Sep 28 15:40:42.481595 dv-cinder-859319-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 28 15:40:42.482184 dv-cinder-859319-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 28 15:40:42.485448 dv-cinder-859319-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 15:40:42.505034 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 15:40:42 2022] *** Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: nodename: dv-cinder-859319-2-iscsi Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: machine: x86_64 Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: clock source: unix Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: pcre jit disabled Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: detected number of CPU cores: 4 Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: current working directory: / Sep 28 15:40:42.507110 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: detected binary path: /usr/bin/uwsgi-core Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: your processes number limit is 47680 Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: your memory page size is 4096 bytes Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: detected max file descriptor number: 2048 Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: lock engine: pthread robust mutexes Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: thunder lock: enabled Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 15:40:42.507869 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 15:40:42.549523 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: Python main interpreter initialized at 0x55f619c349c0 Sep 28 15:40:42.549523 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: python threads support enabled Sep 28 15:40:42.549523 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: your server socket listen backlog is limited to 100 connections Sep 28 15:40:42.549523 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: your mercy for graceful operations on workers is 90 seconds Sep 28 15:40:42.551069 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 15:40:42.551069 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: *** Operational MODE: preforking *** Sep 28 15:40:42.551069 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: *** uWSGI is running in multiple interpreter mode *** Sep 28 15:40:42.551069 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: spawned uWSGI master process (pid: 127055) Sep 28 15:40:42.551069 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: spawned uWSGI worker 1 (pid: 127073, cores: 1) Sep 28 15:40:42.550363 dv-cinder-859319-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 15:40:42.551577 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: spawned uWSGI worker 2 (pid: 127074, cores: 1) Sep 28 15:40:42.551577 dv-cinder-859319-2-iscsi devstack@n-api.service[127055]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 15:40:43.211861 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:40:43.221252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 15:40:44.360869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:40:44.360869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: from cryptography.utils import int_from_bytes Sep 28 15:40:44.361497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:40:44.361497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: from cryptography.utils import int_from_bytes Sep 28 15:40:44.400962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:40:44.400962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: from cryptography.utils import int_from_bytes Sep 28 15:40:44.406741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 15:40:44.406741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: from cryptography.utils import int_from_bytes Sep 28 15:40:46.775037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:40:46.775697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:40:46.775974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:40:46.776233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:40:46.776489 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:40:46.776884 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.777211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.777538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.777891 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.778218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.778530 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.778853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.779178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.779508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.779508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.779508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.779508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-2-iscsi {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.782327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.782327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.782327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.782532 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.782691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.782975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.783329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.783844 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.784286 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.784596 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.784913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.785259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.785571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.785903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.786227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.786534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.786860 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.787168 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.787578 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-2-iscsi {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.787893 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.788205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.788519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.788940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.789255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.789563 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.789908 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.790234 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.790544 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.790870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.791189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.791506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.791831 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.792129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.792438 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.792746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.793066 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.793372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.793679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.793953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.794258 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.794579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.794898 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.795225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.795474 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.795726 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.796045 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.796930 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.797241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.797549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.797869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.798177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.798482 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.798789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.799092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.799397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.799715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.800032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.800354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.800660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.800979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.801390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.801723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.802005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.802369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.802694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.803004 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.803327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.803648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.803964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.804277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.804587 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.804909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.805249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.805553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.805795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.806132 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.806466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.806756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.807369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.810641 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.810641 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.810641 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.810641 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.810913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.811220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.811542 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.811892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.812200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.812507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.812817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.813139 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.813438 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.813738 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.814114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.814422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.814728 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.815046 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.815354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.815664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.815980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.816280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.816585 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.816900 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.817206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.817511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.817812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.818143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.818447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.818751 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.819052 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.819353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.819649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.819969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.820289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.820599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.820907 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.821208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.821531 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.821895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.822232 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.822573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.822886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.823216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.823543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.823859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.824170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.824481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.824804 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.825112 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.825420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.825733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.826069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.826386 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.826716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.827031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.827380 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.827700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.828005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.828325 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.828653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.828973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.829284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.829624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.830009 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.830323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.830525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 15:40:46.831017 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.831174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 15:40:46.831328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.831328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.831628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 15:40:46.831778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.831950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 15:40:46.832116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.832269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 15:40:46.832429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.832577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.832729 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.832884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.833036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.833190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.833335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.833487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.833632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.833824 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.834032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.834202 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.834355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.834501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.834654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.834798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.834956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.835110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.835263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.835414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.835567 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.835718 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.835960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.836153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859319-2-iscsi {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.836381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.836540 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.836687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.836838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.836994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.837162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.837386 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.837536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.837711 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.838003 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.838173 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.838327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.838488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.838659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.838898 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.838898 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.839187 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.839351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.839495 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.839638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.839788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.839944 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.840097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.840278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.840500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.840671 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.840817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.840971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.841116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.841261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.841404 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.841555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.841713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.841979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.842134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.842289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.842445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.842598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.842752 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859319-2-iscsi {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.842905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.843544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.843701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.843853 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.844010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.844164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.844319 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.844472 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.844617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.844761 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.844924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.845078 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.845223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.845373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.845518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.845670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.845821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.846077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.846231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.846402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.846628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.846791 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.846956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.847108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.847255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.847424 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.847648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.847808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.848088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.848253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.848398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.848553 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.848706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.848861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.849655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.849841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.850025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.850180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.850337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.850500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.850729 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.850887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.851040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.851192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.851352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.851499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.851643 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.851793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.851793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.852100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.852260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.852408 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.852551 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.852703 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.852847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.853000 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.853144 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.853295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.853441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.853599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.853743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.853968 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.854119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.854263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.854405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.854557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.854737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.854966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.855140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.855296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.855455 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.855615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.855785 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.855938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.856117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.856335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.856485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.856647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.856877 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.857026 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.857183 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.857516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.857760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.857948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.858168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.858430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.858589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.859389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.859544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.859791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.859943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.860101 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.860247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.860391 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.860542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.860704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.860934 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.861109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.861256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.861407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.861559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.861720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.861905 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.862070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.862223 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.862369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.862513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.862657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.862822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.862977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.863141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.863294 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.863439 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.863439 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.863720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.863872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.864027 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.864179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.864325 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.864475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.864628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.864783 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.864935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.865100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.865245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.865389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.865546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.865691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.866514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.866687 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.866856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.867092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.867254 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.867408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.867564 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.867709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.867955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.868115 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.868325 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.868580 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.868732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.868887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.869038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.869199 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.869352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.869505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.869656 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.869818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.870080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.870254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.870409 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.870561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.870714 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.870869 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.871107 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.871265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.871413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.871564 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.871723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.871945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.872094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.872249 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.872395 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.872553 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.872706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.872852 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.872852 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.873141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.873287 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.873447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.873639 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.873793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.873967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.874126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.874315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.874472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.874617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.874767 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.874912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.875068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.875219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.875374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.875519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.875663 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.875812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.875964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.876274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.876502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.876998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.877243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.877403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.877549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.877703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.877935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.878168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.878368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.878524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.878775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.878935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.879081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.879244 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.879390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.879541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.879687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.879840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.879993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.880239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.880390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.880543 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.880698 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.880859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 15:40:46.881049 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.881294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.881463 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.881610 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.881769 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.881952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882261 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.882996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.883148 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.883303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.884023 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.884194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.884350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.884510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.884663 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.884808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.885039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.885186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.885332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.885475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.885628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.885780 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886027 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886619 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.886989 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.887241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.887474 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.887625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.887778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.887923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.888090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.888333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.888533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.888686 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.888944 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.889110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.889268 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.889420 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.889566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.889724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.889909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.890073 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.890248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.890502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.890652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.890796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.890949 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.891108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.891282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.891520 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.891671 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.891822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.891822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.892216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.892369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.892514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.892677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.892823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.892975 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.893127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.893279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.893432 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.893578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.893732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.893987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.894142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.894297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.894443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.894596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.894753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.894897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895200 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895520 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895672 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.895959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896254 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896410 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.896996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.897153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.897398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.897643 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.897794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.897993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.897993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.898311 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.898573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.898725 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.898890 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.899035 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.899195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.899441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.899592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.899745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.899745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.900036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.900191 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.900335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.900496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.900736 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.900885 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.901040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.901040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.901323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.901491 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.901720 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.901891 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902505 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.902935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.903100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.903245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.903396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.903541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.903692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.903847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904009 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.904901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.905045 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.905195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.905340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906810 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.906969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.907114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.907265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.907514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.907689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.907916 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.908077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.908223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.908375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.908630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.908785 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.908939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909420 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.909997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.910298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.910442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.910585 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.910756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.911000 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.911160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.911305 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.911456 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.911601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.911843 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912325 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.912928 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.913081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.913226 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.913369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.913518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.913663 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.913830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.914003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.914148 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.914562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.914711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.914856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915240 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.915988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.916152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.916315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.916472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.916624 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.916779 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.916924 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.917067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.917236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.917529 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.917756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.917949 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.918172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.918322 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.918487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.918712 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.918914 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.919065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.919211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.919356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.919501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.919673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.919925 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.920085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.920238 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.920392 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.920537 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.920694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.920849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.921021 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.921811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922058 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922688 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.922984 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.923136 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.923295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.923452 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.923604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.923758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.923904 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924665 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.924977 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.925138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.925313 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.925471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.925630 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.925781 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926009 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926179 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.926953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.927105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.927263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.927433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.927692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.927947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.928116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.928366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.928532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.928731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.928897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.929058 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.929219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.929371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.929522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.929672 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.929841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.930149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.930323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.930484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.930642 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.930809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.930961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.931120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.931281 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.931439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.931597 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.931755 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.932014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.932285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.932441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.932600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.932770 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.932933 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.933934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.934244 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.934422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.934585 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.934746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.934899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.935981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.936140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.936140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.936452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.936610 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.936793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.936961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.937113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.937271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.937433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.937586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.937832 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.938094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.938262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.938262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.938677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.938677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939200 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939512 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.939980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.940157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.942930 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.943124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.943288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.943466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.943634 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.943795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.943955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.944114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.944268 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.944436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.944642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.944840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.945005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.945176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.945330 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.945481 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.945695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.945876 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946362 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946685 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.946988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.947138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.947299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.947461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.947623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.947781 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948643 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948736 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.948943 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949131 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949268 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949380 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949606 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949726 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949726 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.949999 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.950977 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951322 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951322 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951614 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.951968 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952348 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952475 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.952838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953132 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953249 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953376 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953727 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.953998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.954956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.955906 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956261 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956563 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.956899 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957131 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957589 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.957969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.958183 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.958327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.958556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.958688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.958855 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959021 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.959936 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960045 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960281 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960407 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.960988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961216 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.961667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.962375 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.962489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.962600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.962710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.962828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.962946 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963504 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.963978 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964420 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964867 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.964987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965528 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.965983 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.966153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.966313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.966465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.966610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.966763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.966914 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.967068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.967220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.967372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.967516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.967660 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.967805 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.968477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.968785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.968934 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.969120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.969277 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.969423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.969577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.969723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.969917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.970081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.970234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.970387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.970543 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.970687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.970953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.971106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.971259 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.971414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.971559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.971711 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.971855 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.972951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.973104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.973278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.973600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.973746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.973910 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.974074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.974236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.974236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.974537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.974689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.974855 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.975046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.975200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.975410 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.975571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.975723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.975874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.976038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.976198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.976357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.976584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.976754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.976986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.977140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.977306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.977466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.977625 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.977784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.977980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.978136 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.978136 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.978431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.978591 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.978897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.979060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.979272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.979432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.979602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.979761 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.979920 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.980081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.980240 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.980398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.980561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.980720 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.980886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.981149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.981308 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.981461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.981611 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.981773 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982000 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982159 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982318 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.982954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.983105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.983256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.983433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.984287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.984469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.984638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.984790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.984947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.985112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.985272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.985438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.985591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.985755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.985924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.986081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.986233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.986413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.986566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.986726 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.986877 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987343 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.987963 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.988123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.988282 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.988452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.988611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.988907 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.989077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.989284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.989443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.989443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.989731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.989930 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.990099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.990265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.990426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.990589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.990740 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.990900 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.991061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.991318 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.991483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.991650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.991810 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.991976 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.992143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.992321 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.992566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.992724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.992897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.993050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.993214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.993367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.993518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.993694 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.994035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.994206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.994369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.994529 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.994681 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.994832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.995935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.996101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.996260 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.996418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.996577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.996735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.996888 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.997059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.997219 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.997371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.997531 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.997690 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.997899 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.998075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.998229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.998379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.998379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.998674 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.998976 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.999148 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.999387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.999546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.999705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:46.999863 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000025 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000625 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.000784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.001094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.001094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.001414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.001868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.002721 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.002897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.003057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.003222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.003382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.003534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.003692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.003845 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.004196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.004367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.004523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.004684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.004844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.005013 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.005179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.005339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.005501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.005660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.005812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.006028 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.006204 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.006390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.006548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.006700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.006851 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.007002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.007166 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.007327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.007479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.007639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.007792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.008000 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.008168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.008328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.008328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.008631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.008783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.009175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.009339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.009548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.009716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.009911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.010082 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.010245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.010399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.010557 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.010557 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.010885 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011366 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.011977 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.012160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.012413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.012570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.012738 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.012911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.013079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.013231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.013382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.013533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.013684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.013875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.014053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.014408 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.014578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.014738 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.014938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.015143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.015589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.015589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.015895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.015994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.016978 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.017807 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018324 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018454 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018681 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018806 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.018918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.019037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.019331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.019331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.019617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.019745 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.019864 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020634 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.020947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021566 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021733 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.021933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022128 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022307 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.022988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023175 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023439 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.023981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024863 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.024964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.025959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026067 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026474 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.026847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027002 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027450 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027631 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027725 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027903 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.027990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028165 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028344 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028892 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.028977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029168 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.029905 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.030010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.030098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.030191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.030277 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.030362 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.030952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031551 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.031990 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032183 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032355 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032830 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.032916 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.033931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034876 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.034962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035329 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035427 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035427 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.035974 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036078 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036258 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036350 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036436 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036521 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.036971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037244 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037429 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037613 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.037996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038182 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.038970 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039590 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.039941 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.040922 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041363 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.041544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.042775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.043195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.043195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.043446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.043771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.044077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.044382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.044882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.045025 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.045303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.045616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.045945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.046918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.047233 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.047917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.048253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.048575 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.048910 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.049242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.049567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.049865 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.051118 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.051446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.051775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.052101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.052419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.052738 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.053055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.053369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.053683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.054019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.054350 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.054645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.054961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.055273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.055587 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.055908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.056211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.056540 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.056865 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.057181 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.057499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.057832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.058169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.058477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.058789 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.059117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.059411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.059748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.060064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.060373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.060799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.061113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.061434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.061781 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.062120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.062445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.062771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.063084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.063405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.063715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.064043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.064383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.064712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.065042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.065352 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.065657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.065984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.066296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.066614 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.066929 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.067231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.067537 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.067968 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.068138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.068433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.068739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.069043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.069349 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.069650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.069983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.070288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.070592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.070896 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.071203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.071509 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.071810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.072112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.072413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.072715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.073015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.073346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.073677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.074011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.074337 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.074649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.074971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.075279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.075600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.075923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.076238 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.076546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.076882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.077190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.077532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.077861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.078176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.078486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.078794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.079222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.079552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.079965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.080506 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.081072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.081651 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.082029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.082596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.083197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.083756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.084334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.084743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.085073 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.085426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.085873 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.086475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.086934 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.087266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.087594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.087932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.088272 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.088590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.088922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.089258 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.089614 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.089967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.090385 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.090722 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.091041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.091357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.091667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 15:40:47.091911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 15:40:47.099887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO dbcounter [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Registered counter for database nova_api Sep 28 15:40:47.120791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.127591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.154388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO dbcounter [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Registered counter for database nova_api Sep 28 15:40:47.174680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.181258 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.183958 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.context [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9312f5f-55a4-4294-b434-e057139feeb0(cell1) {{(pid=127074) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:40:47.188889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:47.189514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:47.191133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:47.191859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:47.192313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:47.194338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:47.196337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO dbcounter [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Registered counter for database nova_cell0 Sep 28 15:40:47.200413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO dbcounter [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Registered counter for database nova_cell1 Sep 28 15:40:47.208099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.209837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.216054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.217344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.237155 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.context [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a9312f5f-55a4-4294-b434-e057139feeb0(cell1) {{(pid=127073) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 15:40:47.241167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:47.241641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:47.243238 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:47.243969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:40:47.244411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:40:47.246421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:40:47.248388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO dbcounter [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Registered counter for database nova_cell0 Sep 28 15:40:47.252759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO dbcounter [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Registered counter for database nova_cell1 Sep 28 15:40:47.259804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.261434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.267032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.272677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.371555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO dbcounter [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Registered counter for database nova_cell0 Sep 28 15:40:47.378581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.382956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.416345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO dbcounter [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Registered counter for database nova_cell0 Sep 28 15:40:47.423252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 15:40:47.427745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 15:40:47.703282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:40:47.710497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:40:47.755280 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:40:47.762630 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:40:48.056324 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:40:48.062412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-fb61799e-d1c6-4351-9b58-9ccb5d03c89b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:40:48.067695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f619c349c0 pid: 127074 (default app) Sep 28 15:40:48.114632 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 15:40:48.120636 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-79af625b-bd8c-44c9-9122-58ecbbf81f1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 15:40:48.125973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f619c349c0 pid: 127073 (default app) Sep 28 15:41:23.727239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:23.728328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:23.729306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:23.730295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:25.651109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-63da4069-1845-4f4b-a100-65828926a742 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Action: 'create', calling method: .version_select at 0x7f1155ed54c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-163283688", "metadata": {"Type": "work"}}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-63da4069-1845-4f4b-a100-65828926a742 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Request method failure captured: Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 121 Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsj2rc4yrNfUC-HttigAiRjgoTtLzGpUsl8B98uxMbQmOaAY14DVneFvuSpf8LseIr4Z_VT35kRRwvvhHJZAeFhBsZeIP0QupXYxHQIcGLr4jra0DQg6pPpe1a5GEgn5KoJKbsIZGwC6CoFKErSvYklDUxjeVAJu3PtIW7im1qN_HA Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:41:25.657835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af27dac96724c4592f66af8801ff80b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 97b222b27b6845e3848db6666db92076 Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-163283688", "metadata": {"Type": "work"}}} Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: Sep 28 15:41:25.659373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-163283688', 'metadata': {'Type': 'work'}}}} Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise error Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi '#$%' Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:41:25.660208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 15:41:25.663007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 15:41:25.664792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 15:41:25.664792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:25.664792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-63da4069-1845-4f4b-a100-65828926a742 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:41:25.664792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-63da4069-1845-4f4b-a100-65828926a742 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.937679 Sep 28 15:41:25.664792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 15:41:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1944 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:41:26.291653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-94bf0e94-390f-42cd-8361-3766c4013ceb tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Action: 'create', calling method: .version_select at 0x7f1155f81f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-278822929", "metadata": {"Type": "work"}}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-94bf0e94-390f-42cd-8361-3766c4013ceb tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Request method failure captured: Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 119 Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsj2rc4yrNfUC-HttigAiRjgoTtLzGpUsl8B98uxMbQmOaAY14DVneFvuSpf8LseIr4Z_VT35kRRwvvhHJZAeFhBsZeIP0QupXYxHQIcGLr4jra0DQg6pPpe1a5GEgn5KoJKbsIZGwC6CoFKErSvYklDUxjeVAJu3PtIW7im1qN_HA Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:41:26.300121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af27dac96724c4592f66af8801ff80b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 97b222b27b6845e3848db6666db92076 Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-278822929", "metadata": {"Type": "work"}}} Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: Sep 28 15:41:26.301704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-278822929', 'metadata': {'Type': 'work'}}}} Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise error Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi '0' Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:41:26.302740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 15:41:26.304334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 15:41:26.305684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 15:41:26.305684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.305684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-94bf0e94-390f-42cd-8361-3766c4013ceb tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:41:26.308377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-94bf0e94-390f-42cd-8361-3766c4013ceb tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.640544 Sep 28 15:41:26.310573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 15:41:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 646 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:41:26.324337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2e807a10-079b-478a-987f-e2a8e5166f2a tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Action: 'create', calling method: .version_select at 0x7f1155ed5dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-9550171", "metadata": {"Type": "work"}}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2e807a10-079b-478a-987f-e2a8e5166f2a tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Request method failure captured: Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 116 Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsj2rc4yrNfUC-HttigAiRjgoTtLzGpUsl8B98uxMbQmOaAY14DVneFvuSpf8LseIr4Z_VT35kRRwvvhHJZAeFhBsZeIP0QupXYxHQIcGLr4jra0DQg6pPpe1a5GEgn5KoJKbsIZGwC6CoFKErSvYklDUxjeVAJu3PtIW7im1qN_HA Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:41:26.332572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af27dac96724c4592f66af8801ff80b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 97b222b27b6845e3848db6666db92076 Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-9550171", "metadata": {"Type": "work"}}} Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: Sep 28 15:41:26.334229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-9550171', 'metadata': {'Type': 'work'}}}} Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise error Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi '' Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:41:26.335161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 15:41:26.336752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 15:41:26.338215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 15:41:26.338215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:26.338215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2e807a10-079b-478a-987f-e2a8e5166f2a tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:41:26.338215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2e807a10-079b-478a-987f-e2a8e5166f2a tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016603 Sep 28 15:41:26.340861 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 15:41:26 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:41:26.350151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:26.351248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:26.352221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:26.353413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:26.358219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3e271d2b-afa7-443a-87c7-fe969db6c08d tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Calling method '.version_select at 0x7f1155f14940>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:27.356320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-3e271d2b-afa7-443a-87c7-fe969db6c08d tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] HTTP exception thrown: Volume tempest-invalid-1501868396 could not be found. Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3e271d2b-afa7-443a-87c7-fe969db6c08d tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Request method failure captured: Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1501868396 HTTP/1.1 Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsj2rc4yrNfUC-HttigAiRjgoTtLzGpUsl8B98uxMbQmOaAY14DVneFvuSpf8LseIr4Z_VT35kRRwvvhHJZAeFhBsZeIP0QupXYxHQIcGLr4jra0DQg6pPpe1a5GEgn5KoJKbsIZGwC6CoFKErSvYklDUxjeVAJu3PtIW7im1qN_HA Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:41:27.360953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af27dac96724c4592f66af8801ff80b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 97b222b27b6845e3848db6666db92076 Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Volume tempest-invalid-1501868396 could not be found. Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': 'tempest-invalid-1501868396'} Sep 28 15:41:27.362221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1501868396 could not be found. (HTTP 404) (Request-ID: req-ed23a8db-3ad4-45ef-9bb1-9078b9a07143) Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.363275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:41:27.366408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1501868396 could not be found. Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:41:27.367479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1501868396 could not be found. Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1501868396 could not be found. Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3e271d2b-afa7-443a-87c7-fe969db6c08d tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Returning 404 to user: Volume tempest-invalid-1501868396 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:41:27.368703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3e271d2b-afa7-443a-87c7-fe969db6c08d tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1501868396" status: 404 len: 99 microversion: 2.1 time: 1.014159 Sep 28 15:41:27.373816 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4bb5c254-b0b7-4af0-b9ef-30972f591ebf tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004251 Sep 28 15:41:27.374709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Sep 28 15:41:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 15:41:27.447905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7f5398fe-34b0-4a30-a724-3c420fcfa3c4 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004439 Sep 28 15:41:27.447905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 4/5] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Sep 28 15:41:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 15:41:27.447905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aff4fa66-32a0-43ff-9893-cdd80c74e6d1 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Calling method '.version_select at 0x7f1155d90670>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:27.448914 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 2/6] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 15:41:26 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1501868396 => generated 99 bytes in 1059 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 28 15:41:27.752592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-aff4fa66-32a0-43ff-9893-cdd80c74e6d1 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] HTTP exception thrown: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aff4fa66-32a0-43ff-9893-cdd80c74e6d1 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Request method failure captured: Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/os-volumes/451552ac-2147-4af0-95e5-00bd64f788c9 HTTP/1.1 Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsj2rc4yrNfUC-HttigAiRjgoTtLzGpUsl8B98uxMbQmOaAY14DVneFvuSpf8LseIr4Z_VT35kRRwvvhHJZAeFhBsZeIP0QupXYxHQIcGLr4jra0DQg6pPpe1a5GEgn5KoJKbsIZGwC6CoFKErSvYklDUxjeVAJu3PtIW7im1qN_HA Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:41:27.756422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af27dac96724c4592f66af8801ff80b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 97b222b27b6845e3848db6666db92076 Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '451552ac-2147-4af0-95e5-00bd64f788c9'} Sep 28 15:41:27.758273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. (HTTP 404) (Request-ID: req-56ec45cf-ca67-4f6c-b0f9-594b4e2c63b3) Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.759293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:41:27.760356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 15:41:27.761415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aff4fa66-32a0-43ff-9893-cdd80c74e6d1 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Returning 404 to user: Volume 451552ac-2147-4af0-95e5-00bd64f788c9 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-aff4fa66-32a0-43ff-9893-cdd80c74e6d1 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/451552ac-2147-4af0-95e5-00bd64f788c9" status: 404 len: 109 microversion: 2.1 time: 0.362478 Sep 28 15:41:27.762626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 5/7] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:41:27 2022] DELETE /compute/v2.1/os-volumes/451552ac-2147-4af0-95e5-00bd64f788c9 => generated 109 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:41:27.781372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-40c5ac71-ea3a-4a56-ad07-0c8788508008 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Calling method '.version_select at 0x7f1155d0fe50>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:27.830713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-40c5ac71-ea3a-4a56-ad07-0c8788508008 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] HTTP exception thrown: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-40c5ac71-ea3a-4a56-ad07-0c8788508008 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Request method failure captured: Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/os-volumes/6fa133a3-c03e-4e84-bb9a-58e98f65c352 HTTP/1.1 Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsj2rc4yrNfUC-HttigAiRjgoTtLzGpUsl8B98uxMbQmOaAY14DVneFvuSpf8LseIr4Z_VT35kRRwvvhHJZAeFhBsZeIP0QupXYxHQIcGLr4jra0DQg6pPpe1a5GEgn5KoJKbsIZGwC6CoFKErSvYklDUxjeVAJu3PtIW7im1qN_HA Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:41:27.834294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2af27dac96724c4592f66af8801ff80b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2af27dac96724c4592f66af8801ff80b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 2af27dac96724c4592f66af8801ff80b Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesNegativeTest-1211253200 Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 97b222b27b6845e3848db6666db92076 Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesNegativeTest-1211253200-project Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '6fa133a3-c03e-4e84-bb9a-58e98f65c352'} Sep 28 15:41:27.836049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. (HTTP 404) (Request-ID: req-45a362ce-df66-45c8-9f8d-b0a500c6c608) Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.836989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:41:27.838707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:41:27.839886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. Sep 28 15:41:27.842336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:41:27.845032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-40c5ac71-ea3a-4a56-ad07-0c8788508008 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] Returning 404 to user: Volume 6fa133a3-c03e-4e84-bb9a-58e98f65c352 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:41:27.846089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-40c5ac71-ea3a-4a56-ad07-0c8788508008 tempest-VolumesNegativeTest-1211253200 tempest-VolumesNegativeTest-1211253200-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6fa133a3-c03e-4e84-bb9a-58e98f65c352" status: 404 len: 109 microversion: 2.1 time: 0.079644 Sep 28 15:41:27.847173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 3/8] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:41:27 2022] GET /compute/v2.1/os-volumes/6fa133a3-c03e-4e84-bb9a-58e98f65c352 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:41:36.078883 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-404d6672-5579-417a-8b26-81913866d40c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: .version_select at 0x7f1155d17ee0>, body: {"keypair": {"name": "tempest-keypair-1054732049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8lFXAAOdRg5rIu1XG2qZjeGH+CdmFuR81dPTvbfQ+K1lgKmkMR0/3LXeYy1/Siou7gGpZ7ih+AQGMFt+KGt5niZVdT+qkas9o90YigNKZUzJ9oICeb1r8tYal1QtEuQA=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:36.216241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-404d6672-5579-417a-8b26-81913866d40c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:36.233703 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-404d6672-5579-417a-8b26-81913866d40c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:36.393603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-404d6672-5579-417a-8b26-81913866d40c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.945384 Sep 28 15:41:36.394260 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 6/9] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:41:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:41:41.555142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a1e2ec1a-4a67-4fac-8a48-f1a0b24288d3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: .version_select at 0x7f1155d0fa60>, body: {"keypair": {"name": "tempest-keypair-628534242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJANqzbJUu8tjuwfhxG1xyLIX+3/qcZ/2mT/2tbfLS+W0vt3mA0zuGDWrr996XfJKpN3hM7uAJc7rvjnhvCwWfZy7lvWMYZvUK650ttQ6x1DqRMmXkrunjuaJjO+FdWinA=="}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:41.703994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-a1e2ec1a-4a67-4fac-8a48-f1a0b24288d3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for project 62692d2b160040879aecaf4d44ad19b3. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:41.723128 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-a1e2ec1a-4a67-4fac-8a48-f1a0b24288d3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for user 634c0af05b334b488f2fa358e574172b and project 62692d2b160040879aecaf4d44ad19b3. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:41.816073 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a1e2ec1a-4a67-4fac-8a48-f1a0b24288d3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.436650 Sep 28 15:41:41.817341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 4/10] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:41:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:41:43.960426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5ec0f83e-acbf-4dfe-985e-c6a7a77a2dd7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'create', calling method: .version_select at 0x7f1155c95790>, body: {"keypair": {"name": "tempest-keypair-1064814110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXMkrg2Mmyk/nN4RNNMG6LvOpm4S0FUJqbnbIGgX7ImZiUTQS+Hpzal4MJZGsPEFuQ1pfrqBQwM62RdkmjU1pjI4DXsMjqX1zxB+N7Ioc+bo7ZCyi+xCIW+zElru3FNfA=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:44.041413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-5ec0f83e-acbf-4dfe-985e-c6a7a77a2dd7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for project 335ecfeb5c6a436e909618c1305593bb. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:44.064642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-5ec0f83e-acbf-4dfe-985e-c6a7a77a2dd7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for user 298dfca23e004969a0c907e18c7237a4 and project 335ecfeb5c6a436e909618c1305593bb. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:44.122198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5ec0f83e-acbf-4dfe-985e-c6a7a77a2dd7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.361455 Sep 28 15:41:44.123183 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 7/11] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Sep 28 15:41:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 363 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 15:41:44.185881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1776112660", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:44.242430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1332022556", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "networks": [{"uuid": "e3f5d48c-3282-4a82-969b-edabdb53cfff"}]}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:44.350935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] validate_networks() for [('b037e357-8df3-4ca3-8b1b-f30273c72384', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:41:44.464326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] validate_networks() for [('e3f5d48c-3282-4a82-969b-edabdb53cfff', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:41:48.116587 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:41:48.117149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:41:48.117463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:41:48.118137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:41:48.118692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:41:48.152891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:48.153577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:48.154780 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:48.159224 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:48.163557 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:48.164011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:48.221455 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for project 824ddb9f6f344a2684cf31d08427306c. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:48.230185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for user 36515ae6f91748babdcf6a9a72f59ed1 and project 824ddb9f6f344a2684cf31d08427306c. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:48.262392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:41:48.265444 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:41:48.455711 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:41:48.456243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:41:48.456598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:41:48.457012 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:41:48.457429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:41:48.501811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-03edec78-4e4d-4487-8075-51e68678ff19 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.481908 Sep 28 15:41:48.502519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 5/12] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:41:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:41:48.515747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:48.516252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:48.516691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:48.524033 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:48.524864 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:48.525300 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:48.546310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-827162015", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df05fe18-9205-4e7c-b6d8-ac63aa67e1aa"}], "security_groups": [{"name": "tempest-securitygroup--1516805446"}], "key_name": "tempest-keypair-1054732049", "user_data": "}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:48.730148 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Getting quotas for project 6822e0b3eedd404895cd4c0c64082344. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:48.775642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Getting quotas for user 922e0b1b4717422abb6f4e93ea15a86d and project 6822e0b3eedd404895cd4c0c64082344. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:48.860038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:41:48.880330 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:41:49.092575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-111ae411-1d4c-4d61-8a9d-e30dc97dfa42 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.967446 Sep 28 15:41:49.096581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 8/13] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 4973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:41:49.111791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-85581322-4fab-4f81-af7d-d42aa9b0394b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:49.114997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-85581322-4fab-4f81-af7d-d42aa9b0394b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:49.217771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] validate_networks() for [('df05fe18-9205-4e7c-b6d8-ac63aa67e1aa', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:41:49.647261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-85581322-4fab-4f81-af7d-d42aa9b0394b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:49.678383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-85581322-4fab-4f81-af7d-d42aa9b0394b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1222 microversion: 2.1 time: 0.579372 Sep 28 15:41:49.679649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 9/14] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:49 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1222 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:49.686304 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d9c56c84-4982-41ff-a9d0-c84c662dc1a2 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:49.693361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d9c56c84-4982-41ff-a9d0-c84c662dc1a2 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:49.854783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d9c56c84-4982-41ff-a9d0-c84c662dc1a2 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:49.869629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d9c56c84-4982-41ff-a9d0-c84c662dc1a2 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1215 microversion: 2.1 time: 0.188011 Sep 28 15:41:49.870473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 10/15] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:49 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:49.892283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1962818322", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2beddede-7b14-4a1e-9c9b-0bc00eba3b72"}], "security_groups": [{"name": "tempest-securitygroup--330010622"}], "key_name": "tempest-keypair-1064814110", "user_data": "}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:50.299679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] validate_networks() for [('2beddede-7b14-4a1e-9c9b-0bc00eba3b72', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:41:51.313761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:41:51.313761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:41:51.314430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:41:51.314430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:41:51.314631 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:41:51.333237 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:51.333734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:51.334976 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:51.335820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:51.336305 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:51.336897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:51.356209 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:41:51.356727 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:41:51.357479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:41:51.358028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:41:51.358591 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:41:51.372203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for project 335ecfeb5c6a436e909618c1305593bb. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:51.378538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for user 298dfca23e004969a0c907e18c7237a4 and project 335ecfeb5c6a436e909618c1305593bb. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:51.378949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:51.384389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:51.385280 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:51.391267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:51.391846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:51.392297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:51.400426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:41:51.403675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:41:51.479353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:51.492080 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:51.509789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-00e70e41-6753-4471-b0c1-c7c188550319 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.633760 Sep 28 15:41:51.520218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 11/16] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Sep 28 15:41:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 15:41:51.530557 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:41:51.533284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2062269178", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85a0d787-d04b-4ff1-9585-ae17b62d54da"}], "security_groups": [{"name": "tempest-securitygroup--287085337"}], "key_name": "tempest-keypair-628534242", "user_data": "}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:51.544440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:41:51.694625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f514e4e8-72d6-4e0b-b716-a29564c0b6ae tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.189673 Sep 28 15:41:51.696840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 6/17] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:41:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:41:51.717568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1086202645", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:41:51.833415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] validate_networks() for [('b037e357-8df3-4ca3-8b1b-f30273c72384', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:41:51.848374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] validate_networks() for [('85a0d787-d04b-4ff1-9585-ae17b62d54da', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:41:53.645788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:41:53.646503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:41:53.647034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:41:53.647753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:41:53.648299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:41:53.670309 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:53.671014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:53.671228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:53.673706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:53.674180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:53.676568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:53.730321 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for project 824ddb9f6f344a2684cf31d08427306c. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:53.742646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for user 36515ae6f91748babdcf6a9a72f59ed1 and project 824ddb9f6f344a2684cf31d08427306c. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:53.759750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:41:53.762944 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:41:53.843156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-52020538-53b2-47d7-aa85-c25634940e12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.145169 Sep 28 15:41:53.846029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 7/18] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:41:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:41:53.860662 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:53.863360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:53.878037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:41:53.878476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:41:53.878939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:41:53.879433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:41:53.879757 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:41:53.907386 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:53.907992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:53.909666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:53.910562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:53.912352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:53.913313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:53.914718 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:53.915546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:53.916857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:53.919980 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:53.925455 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:53.926633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:53.988616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for project 62692d2b160040879aecaf4d44ad19b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:41:53.997358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for user 634c0af05b334b488f2fa358e574172b and project 62692d2b160040879aecaf4d44ad19b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:41:54.027947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:41:54.033988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:41:54.218541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-761c8ded-ca39-4ebb-9c87-c6a327008eb6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.694726 Sep 28 15:41:54.228306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 12/19] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:41:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:41:54.244145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:54.245133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:54.265157 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:54.267056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:54.268654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:54.279600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:54.281553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:54.282583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:54.843856 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:54.909104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-34094ac3-4203-40ae-80da-7cea9683c584 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1273 microversion: 2.1 time: 1.061693 Sep 28 15:41:54.913097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 8/20] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:53 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1273 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:54.922304 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:54.935013 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:54.958100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:54.958608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:54.959042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:54.963307 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:54.971828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:54.976900 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:55.141060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:55.187664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:55.199327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:55.207716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b0891312-6526-4395-8d44-22cd7a3e123e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1334 microversion: 2.20 time: 0.977314 Sep 28 15:41:55.209313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 13/21] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:41:54 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1334 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:41:55.224269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:55.225627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:55.241449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:55.242297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:55.243042 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:55.244136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:55.244812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:55.248066 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:55.363784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:55.374124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5268809b-33ea-4549-bd67-44118f8e745c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.457802 Sep 28 15:41:55.377601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 9/22] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:54 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:55.399201 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-703ed025-ebbd-4b2f-a82e-0a796b728428 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:55.400123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-703ed025-ebbd-4b2f-a82e-0a796b728428 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:55.475214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:55.486453 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a84c7f3e-123d-4f1f-89f2-3a1dfeb1dc46 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1226 microversion: 2.1 time: 0.275627 Sep 28 15:41:55.492809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 14/23] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:55 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1226 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:55.680518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-703ed025-ebbd-4b2f-a82e-0a796b728428 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:55.708256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-703ed025-ebbd-4b2f-a82e-0a796b728428 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1237 microversion: 2.1 time: 0.323368 Sep 28 15:41:55.731147 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 10/24] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:55 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1237 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:55.932828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:55.933791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:55.966136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:55.967045 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:55.967662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:55.971180 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:55.977582 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:55.984462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:56.237938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:56.239514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:56.256495 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:56.261927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:56.279302 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:56.280988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:56.281535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:56.281992 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:56.708616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:56.722850 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9017a850-99d7-4be1-80eb-5fff9b9bca65 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1273 microversion: 2.1 time: 0.793832 Sep 28 15:41:56.748236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 15/25] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:55 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1273 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:56.771536 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:56.774825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:56.794218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:56.794487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:56.796037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:56.796744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:56.799630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:56.800303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:56.803094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:56.805887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:56.807417 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:56.834541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-25ee93e8-84f4-473c-879e-fce72359bc72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1352 microversion: 2.20 time: 0.577734 Sep 28 15:41:56.844093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 11/26] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:41:56 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1352 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:41:56.857704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:56.861757 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:56.888456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:56.889264 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:56.892403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:56.893369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:56.896957 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:56.897607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:57.044862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:57.057631 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e6cced6a-a55f-44c8-982c-4403e9c9dea4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.307982 Sep 28 15:41:57.058961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 16/27] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:56 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:57.094700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:57.095609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:57.125827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:57.126926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:57.129225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:57.131778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:57.139680 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:57.140506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:57.174677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:57.187215 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0f4f9efd-08a4-4e48-bbe8-cc711c9c2b97 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1274 microversion: 2.1 time: 0.341726 Sep 28 15:41:57.189511 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 12/28] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:56 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1274 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:57.359281 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:57.368260 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bdc1fa7f-3ce3-475c-968e-b6d180996c56 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1233 microversion: 2.1 time: 0.289429 Sep 28 15:41:57.385705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 17/29] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:57 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1233 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:57.750412 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:57.752143 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:57.762497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:57.764370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:57.770601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:57.771360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:57.772159 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:57.772729 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:57.871762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:57.873143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:57.881154 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:57.882189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:57.882879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:57.883854 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:57.884469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:57.885270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.016029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.032107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-41e3d0fd-92e5-45e8-9951-cae729528755 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.285412 Sep 28 15:41:58.032898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 13/30] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:57 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:41:58.078852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.088353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:58.088629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:58.095046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:58.095753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:58.096767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.098267 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.098884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:58.099742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.100121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:58.100668 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.100870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-40035928-65a5-41b5-b64a-38a6ee7ae0b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.234922 Sep 28 15:41:58.101588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 18/31] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:41:57 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:41:58.202951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.212405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-21063a12-daa4-4a14-8364-f51483f9fc83 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.129961 Sep 28 15:41:58.213530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 14/32] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:58 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:58.214871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:58.215490 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:58.223677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:58.224158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:58.227692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.230812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:58.231592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:58.232187 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.322709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.332228 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f1ec0aa9-4b8a-42ac-bc68-e1909c01a6e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1274 microversion: 2.1 time: 0.121356 Sep 28 15:41:58.332911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 19/33] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:58 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:41:58.404299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:58.406753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:58.421786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:58.423742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:58.425531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.426516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:58.427486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:58.428181 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:58.684300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:58.701297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-35f62438-4cc0-477f-b2ef-4a62951019e1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1233 microversion: 2.1 time: 0.302742 Sep 28 15:41:58.703119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 15/34] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:58 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1233 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:59.067849 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:59.074980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:59.082551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:41:59.097521 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.098113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.098649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.101620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.102145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.102581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.129987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:59.131159 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:59.140387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.145380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.145838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.147245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.147709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.148135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.292642 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.305714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.307973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.309102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-50be7385-184a-4cab-9f41-e00f7353f9c7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.182987 Sep 28 15:41:59.314043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 16/35] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:41:59 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:41:59.314493 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:59.315270 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:59.336450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.337012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.338075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.338922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.339962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.340787 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.385460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.399589 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4f5054d8-bd61-4684-98a1-261fc668ae23 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.345078 Sep 28 15:41:59.415874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 20/36] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:59 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:59.421412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:59.427973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:59.439802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.440247 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.440682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.441381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.446338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.446801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.466132 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.479333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0c8c7df9-5e16-4fff-bb90-ccb1b474c2ef tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.168276 Sep 28 15:41:59.487171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 17/37] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:59 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:59.556682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.566715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-19056e2a-3019-4a8b-8a8e-819560791f8a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.149198 Sep 28 15:41:59.567794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 21/38] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:59 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:41:59.725988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:41:59.727562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:41:59.742816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.744036 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.745123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.748118 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:41:59.750335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:41:59.753436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:41:59.884769 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:41:59.896854 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-92dbd43a-3209-4a4f-ae57-8854fa1db4dc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1233 microversion: 2.1 time: 0.174710 Sep 28 15:41:59.910336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 18/39] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:41:59 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1233 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:00.336183 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:00.337717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:00.352102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.352863 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.353592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.354607 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.355855 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.356426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.430459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:00.431165 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:00.437763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.444467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.445339 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.446248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.446845 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.447438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.453705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:00.470896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:00.474213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:00.475176 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-788d9ba6-2fa7-4c1c-bfcd-b87bdcdbdb1d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.143223 Sep 28 15:42:00.475917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 22/40] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:00 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:00.505547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:00.506605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:00.513465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.514270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.514909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.515837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.516720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.517363 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.614224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:00.623999 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-02402651-056d-4903-86d2-b5e09cee3833 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.123290 Sep 28 15:42:00.627178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 23/41] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:00 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:00.649235 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:00.650195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:00.657185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.657771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.658303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.659086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.659616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.660113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.760853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:00.784303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-04b3cf78-925b-45d5-8aae-0e72f9d672bb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.139903 Sep 28 15:42:00.786687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 24/42] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:00 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:00.829995 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:00.838270 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-dceda445-2b6f-4b28-b57a-822d1f0ed9d6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.412010 Sep 28 15:42:00.849357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 19/43] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:00 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:00.937252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:00.938166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:00.946149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.947002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.947872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:00.949026 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:00.949617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:00.950200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.017168 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:01.025429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fe1931ee-3e6e-49b1-8544-d5079d3fe611 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1289 microversion: 2.1 time: 0.101313 Sep 28 15:42:01.026235 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 25/44] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:00 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:01.502725 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:01.503342 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:01.509979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.510577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.511079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.512028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.512767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.513460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.604350 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:01.615075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:01.617022 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:01.618382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ee3cd3a6-8cc5-4bd6-9698-057491676eb9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.119805 Sep 28 15:42:01.619784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 20/45] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:01 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:42:01.654354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:01.654966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:01.661219 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.661901 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.662339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.663328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.663929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.664348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.751415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:01.761243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a06f479f-3601-41d3-9e52-88769e645f4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.110703 Sep 28 15:42:01.777583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 26/46] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:01 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:01.808537 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:01.809254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:01.815208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.815684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.816116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.816800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.817333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.817756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.864510 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:01.865299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:01.872672 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.873399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.880412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.881953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:01.887193 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:01.887446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:01.888585 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:01.897287 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1636f9a3-46b7-4e37-ac74-be8bbd878923 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.092436 Sep 28 15:42:01.898813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:01 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:02.054974 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:02.056019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:02.070414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.071767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.072618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.073578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.074252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.074740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.086350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:02.095518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-63274563-658a-4dce-ac53-71180aead1fb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.234840 Sep 28 15:42:02.096280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 27/48] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:01 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:02.141453 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:02.160166 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-668185fb-30ae-49ed-aba5-44ab9d4f7353 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1289 microversion: 2.1 time: 0.112610 Sep 28 15:42:02.173875 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:02 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:02.646418 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:02.647051 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:02.654263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.654742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.655344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.655837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.656281 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.656694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.675307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:02.719276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:02.728272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:02.729731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:02.730966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5cf0103c-5b62-45c0-8b15-b6be33a83443 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.090038 Sep 28 15:42:02.731653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 28/50] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:02 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:02.783739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:02.784361 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:02.790248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.790729 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.791167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.791847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.792308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.792735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.868906 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:02.878009 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8a7979c4-f559-46ab-b385-20ff360ba90e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.098732 Sep 28 15:42:02.879083 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 23/51] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:02 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:02.924252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:02.925369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:02.932094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.933414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.933874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:02.934591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:02.935223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:02.935809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.012526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:03.022437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-358bc00f-9675-4861-aab8-7bea2639dbd6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.101473 Sep 28 15:42:03.022997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 29/52] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:02 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:03.119089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:03.119697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:03.127950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.128732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.129446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.130732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.131356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.132051 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.159406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:03.187201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:03.189886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:03.194705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.195198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.195664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.200870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.201390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.201835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.351987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:03.365866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa4e1770-14bb-451e-98a4-8e8b0f963815 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1289 microversion: 2.1 time: 0.184448 Sep 28 15:42:03.378420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 30/53] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:03 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1289 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:03.389543 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:03.398034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0e36864f-f99b-4234-a335-d1d940270795 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.282770 Sep 28 15:42:03.412821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 24/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:03 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:03.611865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-134451456", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "networks": [{"uuid": "84f80fdf-b0dd-46dc-8fee-113483d41db6"}]}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:03.686927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] validate_networks() for [('84f80fdf-b0dd-46dc-8fee-113483d41db6', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:42:03.761056 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:03.761672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:03.763579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:03.765719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:03.769324 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.769814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.770330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.771227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.771681 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.772103 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.860298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:03.880579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:03.886116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:03.887346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a8986bfb-e7ad-426a-9d66-ec3987e610b4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.130365 Sep 28 15:42:03.888104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 25/55] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:03 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:42:03.902642 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:03.903258 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:03.911317 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.911856 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.912592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.913294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:03.913918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:03.914504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:03.957327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:04.005692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=30 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:04.063734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:04.071643 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-010e9ad6-9521-4ec0-bc1e-2e6eeea45593 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.173144 Sep 28 15:42:04.072515 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 26/56] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:03 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:04.076720 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:04.077322 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:04.083095 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.083565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.083995 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.084676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.085122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.085534 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.210379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:04.224566 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3d58a21c-98f5-472d-8561-fdb3a9b86537 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.151205 Sep 28 15:42:04.225242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 27/57] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:04 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:04.254145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:42:04.254862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:42:04.255512 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:42:04.256112 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:42:04.256586 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:42:04.266263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.266839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.267337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.268167 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.268682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.269168 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.288625 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Getting quotas for project f9b4928b5e2d4f6286e8e56d35c813a9. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:42:04.295941 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Getting quotas for user 5558f9c2bb37403b9ff03f2be1aa3113 and project f9b4928b5e2d4f6286e8e56d35c813a9. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:42:04.308014 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:42:04.310178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:42:04.367373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9f27bdc0-dc49-4806-a41d-09ca7dcd8238 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759684 Sep 28 15:42:04.368870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 31/58] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:42:04.380946 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7e011979-4733-46ea-8fd1-556d0d148d39 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:04.381754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7e011979-4733-46ea-8fd1-556d0d148d39 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:04.397697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:04.399458 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:04.421488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.422011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.422455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.423233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.423690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.424272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.477334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7e011979-4733-46ea-8fd1-556d0d148d39 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:04.491919 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7e011979-4733-46ea-8fd1-556d0d148d39 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1213 microversion: 2.1 time: 0.116319 Sep 28 15:42:04.506431 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:04 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:04.513066 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:04.513680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:04.537727 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.538105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.538542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.539247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.539698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.540118 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.555332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:04.570560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-099ce97a-840b-4fe4-b008-b8b0be66944b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1289 microversion: 2.1 time: 0.181470 Sep 28 15:42:04.584222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 32/60] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:04 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1289 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:04.827389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:04.837962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-74412be7-116c-499d-b8b1-f07cb9f403fc tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.329722 Sep 28 15:42:04.839169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 29/61] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:04 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:04.915916 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:04.917423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:04.929742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.930605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.931228 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:04.931961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:04.933288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:04.934084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.068387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.076461 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.078022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.079966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-94d24065-478b-4595-a6bd-4a0f866e40b5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.170140 Sep 28 15:42:05.096300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:05.100600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:05.106011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 33/62] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:04 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:05.112450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.113267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.113779 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.114615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.115286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.116005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.251603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:05.252541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:05.257500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.267894 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-10ba2398-9676-46cc-987e-1196f9c80374 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.177609 Sep 28 15:42:05.268488 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 30/63] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:05 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:05.269171 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.272690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.273332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.274096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.282770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.285936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.382872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.393799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b1b66db6-afe2-486b-b275-baa11e48728d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.146658 Sep 28 15:42:05.394417 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 34/64] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:05 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:05.520437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:05.521604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:05.530773 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.531823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.532515 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.533241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.533874 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.534524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.598846 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:05.599551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:05.603397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.607160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.608064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.608626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.609726 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.610490 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.611228 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.616907 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7109ccfe-1522-46b1-a3c4-812bad519412 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1217 microversion: 2.1 time: 0.100239 Sep 28 15:42:05.616907 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 31/65] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:05 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:05.708417 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:05.718280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-442aa9c9-32fc-470f-8ea5-b068eee892f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1289 microversion: 2.1 time: 0.123294 Sep 28 15:42:05.718870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 35/66] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:05 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:05.863479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:05.864152 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:05.870414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.871118 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.871751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:05.872459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:05.872911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:05.873333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.002103 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.009558 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bfa2a33c-7491-49ff-a9c1-2f63364c79a5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.150330 Sep 28 15:42:06.010142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 32/67] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:05 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:06.109230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:06.109828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:06.115670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.116152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.116595 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.117283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.117735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.118185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.178055 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.186362 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.187804 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.188909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cbdc44cd-5827-4568-9b14-e69e76e9ef53 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.083779 Sep 28 15:42:06.189465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 36/68] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:06 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:06.295633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:06.296825 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:06.303122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.303607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.304043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.305234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.305703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.306151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.369406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.379117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1963d414-0602-4b4a-854c-bdf2ec2023d8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.087397 Sep 28 15:42:06.394224 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:06 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:06.417064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:06.417831 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:06.425346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.426159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.426604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.427450 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.428231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.428806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.640357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:06.641629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:06.654582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.655112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.657168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.657957 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.659922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.660359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.922313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.936312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5990c7d6-4d53-4eac-bf74-b88fa04f6835 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1282 microversion: 2.1 time: 0.521132 Sep 28 15:42:06.939248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 37/70] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:06 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1282 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:06.953265 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:06.964102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:06.972701 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:06.986635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-58f59aab-cdd5-4cf2-a0fc-2bf0297139ff tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1209 microversion: 2.1 time: 0.349953 Sep 28 15:42:06.989006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 34/71] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:06 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1209 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:06.989837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.991410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.991855 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:06.992580 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:06.993039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:06.993464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.040220 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:07.041682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:07.058824 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.059506 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.062918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.066209 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.066879 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.068419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.207943 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:07.221887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-efaef154-3f70-46fc-8387-ea8849f2e126 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1289 microversion: 2.1 time: 0.279081 Sep 28 15:42:07.223451 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 38/72] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:06 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1289 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:07.239607 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:07.244184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:07.254552 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.255427 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.255955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.256879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.257578 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.258238 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.366302 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:07.376557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:07.378293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:07.380282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6d06eea7-fdcd-4731-b349-2f2e07875002 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.151118 Sep 28 15:42:07.381439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 39/73] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:07 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:07.409897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:07.410688 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:07.418918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.422985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.423948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.429735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.430550 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.431666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.702917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:07.712016 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d3fa3507-10b9-4686-b64b-72fa9c57936a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1299 microversion: 2.1 time: 0.306198 Sep 28 15:42:07.712710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 40/74] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:07 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:07.911659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:07.924524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-27c96f5a-e16c-4491-900a-42950210ca6f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.890944 Sep 28 15:42:07.926044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 35/75] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:07 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:07.963091 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:07.964352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:07.972682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.973734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.975159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:07.977345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:07.977943 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:07.978577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.018121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:08.019014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:08.032959 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.037503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.038045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.038798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.039270 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.040002 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.227102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:08.235877 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-72f38c6e-c114-4296-a2b6-5e8e7ee2e9fd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1280 microversion: 2.1 time: 0.277703 Sep 28 15:42:08.238836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 41/76] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:07 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:08.252161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:08.253027 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:08.259887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:08.269813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b7cb0012-35a7-48e5-a612-3db4d58ed68f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1273 microversion: 2.1 time: 0.256755 Sep 28 15:42:08.273401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.275015 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.275633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.276538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.279543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.280295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.281149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 36/77] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:08 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:08.412125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:08.412725 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:08.436754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.437297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.437740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.438513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:08.438932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.439440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.439866 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.451447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-dab87d25-b44c-423d-a2ff-896136ef5c21 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1295 microversion: 2.1 time: 0.207275 Sep 28 15:42:08.453366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 42/78] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:08 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1295 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:08.706088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:08.738038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:08.739447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:08.746558 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:08.749639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.750551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.752088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:08.752753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.753580 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.757296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fda0cacb-2983-4a25-924a-1ac16a6f62cd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1340 microversion: 2.20 time: 0.348969 Sep 28 15:42:08.762888 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 37/79] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:08 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1340 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:42:08.765809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.767449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.949707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:08.950373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:08.957891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.958456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.958959 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:08.959751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:08.960272 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:08.960913 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:09.523231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:09.550163 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f0ff9c69-f9ab-4683-b7c6-c05daeaa3f79 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.804027 Sep 28 15:42:09.554667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 43/80] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:08 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:09.563723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:09.571912 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:09.591065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:09.591894 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:09.599166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:09.600263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:09.601014 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:09.601547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:09.774712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:09.790452 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a949f06f-3a4d-45f8-b936-2aee1c5073f6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.845471 Sep 28 15:42:09.791036 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 38/81] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:08 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:09.796303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:09.800535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:09.813189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:09.813757 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:09.814191 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:09.814904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:09.815411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:09.815785 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:09.841519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:09.854052 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a3ebd78c-70f5-434b-9543-6b30798f57e6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1280 microversion: 2.1 time: 0.296474 Sep 28 15:42:09.855825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 44/82] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:09 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:09.984677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be", "tag": "ee69f789-a694-42a3-869d-d84a727eae15"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:10.005445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.005579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:10.006121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.006611 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.016105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-50813d37-20bb-4e78-8240-cb9733f19a51 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1271 microversion: 2.1 time: 0.223245 Sep 28 15:42:10.019301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 39/83] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:09 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:10.043267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:10.045497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Creating event network-changed:ee69f789-a694-42a3-869d-d84a727eae15 for instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be on hv-cinder-85931 Sep 28 15:42:10.047106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 15:42:10.047227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:10.048709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d4fb3032-334b-4464-b712-b50a07b8cc5d req-9422654f-d3ed-4585-b92a-5dd062d52967 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 15:42:10.051630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.051870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.054425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.059441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.059932 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.060368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.068638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.070008 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.070462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.075400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.075894 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.076341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.077134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.compute.rpcapi [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 15:42:10.078659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] Releasing lock "compute-rpcapi-router" {{(pid=127074) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 15:42:10.106346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-36968909-5121-42f2-b297-8ec8df6fa00f None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249001 Sep 28 15:42:10.107905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 45/84] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:10.118682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:10.119796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:10.130143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.131492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.132136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.133457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:10.134377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:10.135067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:10.141736 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:10.961102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:10.985645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:10.988043 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:10.989746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d53acdce-de2c-4887-aaed-84dbabd0ec23 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.879759 Sep 28 15:42:10.991140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 46/85] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:10 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:11.000417 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:11.001603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:11.005819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:11.015381 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-aa864036-d040-4bfc-b3b2-e7fef1a3bfa5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.995044 Sep 28 15:42:11.018235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 40/86] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:10 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:11.026361 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:11.027222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:11.033573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.034135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.034840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.035751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.036685 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.037415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.050733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.051600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.053158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.054783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.054916 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.057730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.474228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:11.490420 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-92f492d8-b706-4d0b-96ae-afd5ef0e5b16 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.470255 Sep 28 15:42:11.490998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 41/87] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:11 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:11.496166 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:11.496953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:11.508244 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:11.514695 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.515864 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.516531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.516671 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-84cd6f5a-4d24-48f9-a132-a32029b93884 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.524147 Sep 28 15:42:11.517423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 47/88] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:10 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:11.517667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.523913 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.525378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.550420 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:11.620125 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-b3c9888b-d063-4bac-9dd9-83318f48f3b7 req-98a34c7d-35a2-433a-a307-c44bc10bf41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ad4def-5dcf-41f5-be4c-e251a8e878af", "tag": "55efe6f9-e65a-4754-9095-ac7b9f3c3e10"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:11.630888 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b3c9888b-d063-4bac-9dd9-83318f48f3b7 req-98a34c7d-35a2-433a-a307-c44bc10bf41a service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.631591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b3c9888b-d063-4bac-9dd9-83318f48f3b7 req-98a34c7d-35a2-433a-a307-c44bc10bf41a service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.632697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b3c9888b-d063-4bac-9dd9-83318f48f3b7 req-98a34c7d-35a2-433a-a307-c44bc10bf41a service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.646007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-b3c9888b-d063-4bac-9dd9-83318f48f3b7 req-98a34c7d-35a2-433a-a307-c44bc10bf41a service nova] Creating event network-changed:55efe6f9-e65a-4754-9095-ac7b9f3c3e10 for instance d9ad4def-5dcf-41f5-be4c-e251a8e878af on hv-cinder-85931 Sep 28 15:42:11.651706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-b3c9888b-d063-4bac-9dd9-83318f48f3b7 req-98a34c7d-35a2-433a-a307-c44bc10bf41a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132440 Sep 28 15:42:11.652309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 48/89] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:11.657435 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:11.658629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:11.666203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.667167 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.667603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.668467 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:11.669073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:11.669633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:11.822597 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:11.830730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-51cc0fa3-db74-439e-a215-4180f4c82484 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.338577 Sep 28 15:42:11.831536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 42/90] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:11 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:11.920360 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:11.927908 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a8ad104a-83a8-4a59-b413-4f8bf046903b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.274290 Sep 28 15:42:11.928471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 49/91] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:11 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:12.017837 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:12.018555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:12.024471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.024955 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.025390 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.026738 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.027195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.027620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.043911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:12.044639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:12.050673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.051149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.051579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.052261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.052707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.053123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.217203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.225130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.226606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.227706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-69402332-c2c4-4390-910b-b8e4b0b2e2d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.213775 Sep 28 15:42:12.228027 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.228248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 43/92] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:12 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:12.232689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cb3a9e-72d1-4502-90fe-35576e05e0a2", "tag": "0fdce35c-d94c-4241-8f30-04b6de93d44d"}, {"name": "network-changed", "server_uuid": "8ac91576-c5d2-418a-a1c5-af43fccf4e46", "tag": "9e5dd716-5edb-44f2-a44f-e25367a21810"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:12.239151 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-03f87fe8-c20f-4eec-8d89-7d7aafae2e51 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.199349 Sep 28 15:42:12.239811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 50/93] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:12 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:12.246627 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.247106 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.247533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.267916 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Creating event network-changed:0fdce35c-d94c-4241-8f30-04b6de93d44d for instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 on hv-cinder-85931 Sep 28 15:42:12.268423 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Creating event network-changed:9e5dd716-5edb-44f2-a44f-e25367a21810 for instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 on hv-cinder-85931 Sep 28 15:42:12.268933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 15:42:12.269320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b4b5d908-48f6-4594-9660-85827a46e6c5 req-6c929bf4-a46d-496b-b465-5cf0d650f6e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 15:42:12.270347 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.270798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.271218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.271924 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.272367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.272822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.281469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.compute.rpcapi [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 15:42:12.282350 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] Releasing lock "compute-rpcapi-router" {{(pid=127073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 15:42:12.298402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-105617aa-226a-4eae-87bf-1b508b490b3a None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068921 Sep 28 15:42:12.298985 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 44/94] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:12.515677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:12.516283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:12.522266 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.522745 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.523187 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.523902 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.524359 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.524781 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.542600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:12.543301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:12.549816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.550274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.550706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.551397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.551847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.552271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.709172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.717372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-65e60928-6cb2-4876-b080-1f95043c89bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.205449 Sep 28 15:42:12.718059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 51/95] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:12 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:12.736231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.743824 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-527d601c-360b-4b77-bbaf-6e7cbbba03b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.205652 Sep 28 15:42:12.744386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 45/96] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:12 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:12.853340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:12.853963 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:12.860321 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.860796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.861224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.861926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.862373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.862806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.950682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:12.951294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:12.957110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.957587 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.958059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.958748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:12.959196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:12.959620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:12.990158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:12.997832 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ce7f0193-3f89-4f27-9c49-3d72b9e98fdd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.148223 Sep 28 15:42:12.998428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 52/97] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:12 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:13.083422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:13.091470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-436901bd-5ef2-44b5-b951-61d49bee982b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.144533 Sep 28 15:42:13.092217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 46/98] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:12 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:13.253551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:13.254161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:13.265836 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:13.266773 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:13.267890 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:13.268653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:13.269224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:13.269969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:13.270421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:13.270842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:13.275492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:13.277773 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:13.278334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:13.279305 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:13.279839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:13.280567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.155312 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:14.163484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7d040e9b-cdcb-457a-8fef-322b8250dd1e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.904146 Sep 28 15:42:14.164057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 47/99] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:13 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:14.169239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-9e8a4b67-2164-4c1f-bbf7-049b33317f8c req-d4510b01-af91-4c40-add6-cca8a9839df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:14.178530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-9e8a4b67-2164-4c1f-bbf7-049b33317f8c req-d4510b01-af91-4c40-add6-cca8a9839df0 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.179000 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-9e8a4b67-2164-4c1f-bbf7-049b33317f8c req-d4510b01-af91-4c40-add6-cca8a9839df0 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.179422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-9e8a4b67-2164-4c1f-bbf7-049b33317f8c req-d4510b01-af91-4c40-add6-cca8a9839df0 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.192426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-9e8a4b67-2164-4c1f-bbf7-049b33317f8c req-d4510b01-af91-4c40-add6-cca8a9839df0 service nova] Creating event network-changed:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:42:14.197489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-9e8a4b67-2164-4c1f-bbf7-049b33317f8c req-d4510b01-af91-4c40-add6-cca8a9839df0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032164 Sep 28 15:42:14.198205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 48/100] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:14.203124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:14.203820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:14.210148 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.210626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.211050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.211743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.212194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.212590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.213643 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:14.221800 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:14.223292 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:14.224751 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ec666762-2c3c-402a-9eea-f8ed00472b72 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.975058 Sep 28 15:42:14.225067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 53/101] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:13 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:14.229724 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:14.231104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:14.237252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.237867 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.238365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.239471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.240121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.240701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.304520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:14.482550 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=26 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:14.620156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:14.622820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:14.628785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b695979c-a60e-4a95-8890-0a87bf0467a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.402491 Sep 28 15:42:14.629572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 54/102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:14 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:14.631714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0fc389ff-c4dc-4d06-a5e9-8c01c08ade20 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.431949 Sep 28 15:42:14.632663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 49/103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:14 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:14.648546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:14.648782 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:14.649235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:14.649580 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:14.656098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.656349 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.656756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.656865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.657262 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.657348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.657881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.658022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:14.658331 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.658439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:14.658745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:14.658839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.538207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:15.546121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:15.548031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a4404912-e86b-4a26-b00a-2c686a2b1e4f tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.914167 Sep 28 15:42:15.548655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 50/104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:14 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:15.553591 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:15.554225 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:15.561660 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.562370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.562968 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.563972 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.564566 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.566711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.575624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-238e4cdc-4f12-490f-9424-8a45c1947eb7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.944795 Sep 28 15:42:15.576299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 55/105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:14 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:15.589449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:15.590253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:15.597605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.598136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.598571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.599335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.599784 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.600369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.915681 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:15.923958 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6e49f9bd-2caf-4585-8ffd-215f536166d7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.374164 Sep 28 15:42:15.924522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 51/106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:15 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:15.929714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:15.930049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:15.936543 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.937181 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.937616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.938565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.939200 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.939758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.944918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:15.953579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:15.955371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:15.956646 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-beaf06a1-8e32-4c26-be3e-2458c26fbd40 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.379284 Sep 28 15:42:15.969878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 56/107] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:15 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:15.974292 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:15.974909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:15.982290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.982780 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.983206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:15.983903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:15.984349 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:15.984769 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.414291 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:16.422577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-dbef25f1-c474-4b9c-91bc-62230194790b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.497073 Sep 28 15:42:16.423397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 52/108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:15 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:16.429137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e20f44-0cc8-40c9-9cf4-c96af23c7e05", "tag": "43948096-55d0-43b4-a3ff-177477a90fc2"}, {"name": "network-changed", "server_uuid": "69488fec-c032-4a06-aebf-169b15da1e74", "tag": "41aaafcb-981e-4fbf-8c80-bbb43167a049"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:16.442787 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.443399 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.443901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.457955 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] Creating event network-changed:43948096-55d0-43b4-a3ff-177477a90fc2 for instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 on hv-cinder-85931 Sep 28 15:42:16.458529 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] Creating event network-changed:41aaafcb-981e-4fbf-8c80-bbb43167a049 for instance 69488fec-c032-4a06-aebf-169b15da1e74 on hv-cinder-85931 Sep 28 15:42:16.460701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:16.467343 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-c3f52285-e7cb-4bdc-ac6d-8fadb59952b0 req-f8ee48ee-1b6e-4948-ab78-ad4fff09bae4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042620 Sep 28 15:42:16.469100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 53/109] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:16.473305 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-80bac83f-7203-45b6-a55e-af2d5ca65497 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.507634 Sep 28 15:42:16.474347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 57/110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:15 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:16.572891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:16.573589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:16.580987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.581475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.582415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.583279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.583857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.584341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.601628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:16.602411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:16.612419 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.613798 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.615214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.616207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.616931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.617500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.806840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:16.819143 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6f959131-99ac-4eb9-aa1b-5c94e61d5815 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.250293 Sep 28 15:42:16.820121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 54/111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:16 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:16.829809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:16.838210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c0b65cdd-f9ed-47ad-b1f3-6c6d89f6849d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.241859 Sep 28 15:42:16.838777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 58/112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:16 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:16.952041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:16.952891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:16.961412 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.962130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.962865 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.966406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.967053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.967859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.982484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:16.983091 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:16.992120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.992614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:16.994155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:16.999439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:16.999940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.000628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.703176 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:17.711575 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:17.716451 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:17.718253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:17.719549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e3d83690-1d2e-4b6e-bcd3-75a462a4e735 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.741320 Sep 28 15:42:17.719918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e0c022c3-677d-4970-9806-910149803466 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.774740 Sep 28 15:42:17.720509 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 55/113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:16 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:17.725734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:17.726626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:17.734162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:17.735118 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 59/114] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:16 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:42:17.735234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.736145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.736891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:17.737346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.737768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.745693 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:17.746587 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:17.753107 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:17.753936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.754557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.755699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:17.756339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.756941 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.963244 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:17.966568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:17.972679 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a23a15fa-a9be-489d-b1a9-41007b253149 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.250864 Sep 28 15:42:17.973364 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 56/115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:17 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:17.976549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7927ce12-ec2e-4235-a844-767038796bf3 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.240299 Sep 28 15:42:17.977123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 60/116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:17 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:17.978908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:17.979673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:17.986303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:17.986871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:17.987133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.987484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:17.988048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.988869 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:17.989443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:17.990768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:17.999948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:18.000859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:18.001443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:18.002828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:18.003431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:18.004001 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:18.234580 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:18.248246 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fdba75cd-7e8d-4af0-964d-25231c612ace tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.273954 Sep 28 15:42:18.250588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 57/117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:17 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:18.267965 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:18.276074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-88356e30-2c7f-4cf0-a468-799f39ee4eaa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.297557 Sep 28 15:42:18.276990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 61/118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:17 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:18.743754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:18.744373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:18.752916 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:18.753546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:18.755871 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:18.756401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:18.757028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:18.757927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:18.764571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:18.765058 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:18.765486 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:18.765784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:18.766449 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:18.766754 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:18.769293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:18.769761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.442985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:19.460396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:19.462654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:19.468011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:19.469667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-12f2f6b0-aeb3-4cfe-be92-83465cbcd14b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.730412 Sep 28 15:42:19.470794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9ebfb30b-fa09-407e-b171-0e6b2db4a6cb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.722823 Sep 28 15:42:19.471385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 62/119] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:18 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:19.475850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 58/120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:18 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:19.492126 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:19.494173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:19.497662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:19.498316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:19.504491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.505240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.506271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.507501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.507906 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:19.508504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.509027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.510470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.511076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.511715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.512594 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.513901 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.514347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.545954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:19.706710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:19.715127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0d31710b-7b8c-4384-8f26-cde306de605b tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.232215 Sep 28 15:42:19.730629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 59/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:19 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:19.737617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:19.739300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:19.739914 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:19.747266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.748167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.748167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.748816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.749154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.750743 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c081cbf9-b96c-4518-a097-423a487df823 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.264516 Sep 28 15:42:19.762244 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 63/122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:19 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:19.763572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.767600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:19.769182 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:19.773633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:19.777776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.778354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.778994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:19.779936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:19.780737 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:19.781351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.075335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=4 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:20.239016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:20.258132 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3d48adc7-3a61-4030-962c-b7669e60d8c4 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.526039 Sep 28 15:42:20.258949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 60/123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:19 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:20.289578 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:20.297680 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a5b01500-c214-4ddf-952f-c51a33ba99c7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.544339 Sep 28 15:42:20.298309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 64/124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:19 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:20.502642 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:20.503221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:20.508450 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:20.509650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:20.514623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.516173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.517744 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.521129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.521665 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.522170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.522444 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.523045 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.523964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.524361 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.524802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.526308 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.816294 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:20.825361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3c84dbeb-e522-463d-83ff-8625259978a0 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.322574 Sep 28 15:42:20.831744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 65/125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:20 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:20.851204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:20.852217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:20.859782 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.860571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.861207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.862141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.862784 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.863402 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.876604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:20.889818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:20.891384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:20.892917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1d47fc51-7fd0-4d3f-9cef-afdf6a7e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.397229 Sep 28 15:42:20.894079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 61/126] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:20 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:20.899239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:20.899986 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:20.906016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.906567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.907127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:20.908285 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:20.909256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:20.909815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.180033 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:21.188950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:21.204097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-55b2983d-89b7-43a5-b226-26d6300d760e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.306624 Sep 28 15:42:21.205042 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-adc70ece-3ac9-4ef5-a823-75005b067712 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.357551 Sep 28 15:42:21.206679 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 62/127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:20 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:21.207238 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 66/128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:20 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:21.284188 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:21.285009 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:21.292986 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.293615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.294144 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.295111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.295752 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.296362 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.322378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:21.323739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:21.331080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.331883 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.332465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.333332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.334071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.334666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.510461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:21.519389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1f1f320a-26d1-4f4f-acc0-bf7355e47814 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.242719 Sep 28 15:42:21.520145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 63/129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:21 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:21.539761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:21.549924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-181094f3-19e2-4069-8d5a-16cd670912f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.232719 Sep 28 15:42:21.550807 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 67/130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:21 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:21.853214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:21.854048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:21.861432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.862575 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.863091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.863961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.864536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.865106 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.921673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:21.922965 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:21.930050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.930879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.931526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:21.932353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:21.933519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:21.934152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.174903 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:22.184682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-71e49461-5acd-4d7a-bb51-e3e405abbe65 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.335347 Sep 28 15:42:22.185923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 64/131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:21 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:22.221412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:22.232295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:22.232295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:22.237233 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.237715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:22.238121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.238605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.239726 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.240400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.240558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:22.240832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.242205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-44f55380-f34f-4b0f-97a8-4e01a5804369 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.325547 Sep 28 15:42:22.243218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 68/132] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:21 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:42:22.257654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:22.259328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:22.281713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.282452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.283039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.283929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.284547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.284971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.287835 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:22.608791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:22.628175 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3c09b9fa-b633-456f-81d5-f592bb1a8e82 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.383646 Sep 28 15:42:22.629042 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 69/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:22 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:22.640081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:22.648050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2f6a010c-3f09-4542-8402-e5c7ce72f64e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.423261 Sep 28 15:42:22.648232 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:22.648797 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:22.652701 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 65/134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:22 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:22.655317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.655976 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.656539 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.657402 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.658018 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.658572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.689323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:22.690821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:22.699278 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.699911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.700433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:22.701345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:22.702069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:22.702695 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.114140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:23.125970 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c085ff3c-2d98-4f1b-8e4d-0fb5e95e92c5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.481417 Sep 28 15:42:23.126552 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 70/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:22 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:23.172214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:23.181004 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-93386376-2a89-4e14-9f81-f13c6803f5ae tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.502805 Sep 28 15:42:23.181650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 66/136] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:22 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:23.209259 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:23.209884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:23.222858 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.223353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.225257 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.226028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.228271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.228706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.500861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:23.510142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-16aa74cd-485b-478a-a1ff-82bd5cf0f4be tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.305139 Sep 28 15:42:23.512147 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 67/137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:23 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:23.517565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:23.520600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:23.537763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.539880 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.540053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-97ef4002-cec5-4f11-8b93-6f2da97db9a7 req-6de61fd2-5f55-4e9a-9f54-6c8031313ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "name": "network-vif-plugged", "status": "completed", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:23.540431 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.541236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.544301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.544796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.553786 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-97ef4002-cec5-4f11-8b93-6f2da97db9a7 req-6de61fd2-5f55-4e9a-9f54-6c8031313ba4 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.554556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-97ef4002-cec5-4f11-8b93-6f2da97db9a7 req-6de61fd2-5f55-4e9a-9f54-6c8031313ba4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.555375 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-97ef4002-cec5-4f11-8b93-6f2da97db9a7 req-6de61fd2-5f55-4e9a-9f54-6c8031313ba4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.570189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-97ef4002-cec5-4f11-8b93-6f2da97db9a7 req-6de61fd2-5f55-4e9a-9f54-6c8031313ba4 service nova] Creating event network-vif-plugged:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:42:23.576994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-97ef4002-cec5-4f11-8b93-6f2da97db9a7 req-6de61fd2-5f55-4e9a-9f54-6c8031313ba4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.449268 Sep 28 15:42:23.578197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 71/138] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:23.659205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:23.663222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:23.675275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.676336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.677283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.678418 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.679119 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.679725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.906800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:23.918296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:23.919752 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:23.920900 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-115619b2-244d-4644-8dd3-38a9b7f36344 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.406949 Sep 28 15:42:23.921517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 68/139] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:23 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:23.929738 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:23.930437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:23.936561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.937047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.937478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:23.945410 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:23.945985 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:23.946429 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.066127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:24.087278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4463c47c-f40a-40b5-b97c-d577ecacb839 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.439586 Sep 28 15:42:24.111579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 72/140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:23 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:24.151296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:24.152530 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:24.159222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.159963 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.160396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.161105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.161560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.162092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.175875 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:24.186014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ec0eac0e-87be-41a8-b461-f07a74a6061b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.263420 Sep 28 15:42:24.189813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 69/141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:23 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:24.204294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:24.204897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:24.212323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.212943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.213667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.215757 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.216645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.217237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.482574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:24.487263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:24.495703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9241859e-dcb0-4cbc-9007-a763c25236e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.294612 Sep 28 15:42:24.498216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c6f4a4d8-9ebb-489d-8009-5a11cf02d2b5 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.347959 Sep 28 15:42:24.499526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:24 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:24.513870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 70/143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:24 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:24.536225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:24.537077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:24.544337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.545060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.545643 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.546619 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.547236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.547660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.948400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:24.949015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:24.956185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.956669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.957525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:24.963662 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:24.966175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:24.966797 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.047205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.070689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-08d73ae4-1a35-4431-901f-181d613d4352 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.537688 Sep 28 15:42:25.091097 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 74/144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:24 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:25.113443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:25.114509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:25.124713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.126735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.127700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.132338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.133809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.135679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.210842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.228170 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.232842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.237318 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ba74a36a-9100-41d5-88e9-ff093efd1cc0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1407 microversion: 2.20 time: 0.294270 Sep 28 15:42:25.238170 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 71/145] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:24 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:25.242453 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:25.243054 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:25.265080 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.265573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.266047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.266832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.267195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.267591 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.454300 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.464597 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-686f9472-24a3-402a-9145-b839871642bf tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.354604 Sep 28 15:42:25.465759 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 75/146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:25 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:25.484684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.492688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-787dc4da-2747-4e92-bd38-327009177424 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.253748 Sep 28 15:42:25.493574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 72/147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:25 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:25.523468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:25.523950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:25.524198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:25.524581 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:25.531355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.531564 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.531964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.532252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.532648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.532758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.533336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.533438 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.533780 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.534022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.534222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.534426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.738348 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.746385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:25.747992 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0cd53f35-483b-42ae-a92e-f27a2aea3eeb tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.228016 Sep 28 15:42:25.750289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 73/148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:25 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:25.756522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-854ef542-d9c5-4bec-88cc-74e1322569a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.237100 Sep 28 15:42:25.759086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:25 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:25.760487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be", "name": "network-vif-plugged", "status": "completed", "tag": "ee69f789-a694-42a3-869d-d84a727eae15"}, {"server_uuid": "8ac91576-c5d2-418a-a1c5-af43fccf4e46", "name": "network-vif-plugged", "status": "completed", "tag": "9e5dd716-5edb-44f2-a44f-e25367a21810"}, {"server_uuid": "d9ad4def-5dcf-41f5-be4c-e251a8e878af", "name": "network-vif-plugged", "status": "completed", "tag": "55efe6f9-e65a-4754-9095-ac7b9f3c3e10"}, {"server_uuid": "38cb3a9e-72d1-4502-90fe-35576e05e0a2", "name": "network-vif-plugged", "status": "completed", "tag": "0fdce35c-d94c-4241-8f30-04b6de93d44d"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:25.770648 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:25.773345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:25.773823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:25.774262 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:25.790608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Creating event network-vif-plugged:ee69f789-a694-42a3-869d-d84a727eae15 for instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be on hv-cinder-85931 Sep 28 15:42:25.791148 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Creating event network-vif-plugged:9e5dd716-5edb-44f2-a44f-e25367a21810 for instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 on hv-cinder-85931 Sep 28 15:42:25.791644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Creating event network-vif-plugged:55efe6f9-e65a-4754-9095-ac7b9f3c3e10 for instance d9ad4def-5dcf-41f5-be4c-e251a8e878af on hv-cinder-85931 Sep 28 15:42:25.792167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] Creating event network-vif-plugged:0fdce35c-d94c-4241-8f30-04b6de93d44d for instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 on hv-cinder-85931 Sep 28 15:42:25.801510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-08deb53d-d48a-4c0f-bb63-2bc925c58771 req-faf159aa-9176-415d-8334-fae0cda207e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.046773 Sep 28 15:42:25.802139 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 74/150] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:26.098553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:26.099438 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:26.106994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.107546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.108193 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.109165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.109794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.110659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.252191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:26.260458 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-560c7d1d-22fa-4033-bfc0-d2c4d710e675 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.167091 Sep 28 15:42:26.273874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 77/151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:26 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:26.274623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:26.274623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:26.275073 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.275649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.276457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.279565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.280235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.280796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.421289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:26.431092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:26.432633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:26.433880 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-aca51bca-6691-474b-9064-787a1ba1d289 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1599 microversion: 2.20 time: 0.172944 Sep 28 15:42:26.437679 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 75/152] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:42:26 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:42:26.465241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:26.465798 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:26.472243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.472918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.473754 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.474796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.475384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.475947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.488743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:26.489549 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:26.500368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.500881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.501325 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.502061 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.502522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.503345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.844368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:26.854999 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6d90a9be-6148-46a5-9561-e3ef091317b8 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.369955 Sep 28 15:42:26.855578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 76/153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:26 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:26.872394 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0ad501a1-f392-447f-8e07-929f15dbf2df tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.411476 Sep 28 15:42:26.873173 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 78/154] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Sep 28 15:42:26 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-interface => generated 284 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:42:26.877989 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:26.878608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:26.894740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:26.895163 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.895660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.896104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.896810 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.897195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:26.897319 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.897670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.907752 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.908852 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.910030 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:26.911524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:26.912516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:26.913164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.228682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:27.231888 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:27.233601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:27.240181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ce66d3f9-bddd-4937-a9e9-bafe91ca6a33 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.366107 Sep 28 15:42:27.241512 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 79/155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:26 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:27.247987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:27.249518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:27.255293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-14fba6ce-46b4-4fe1-8bdf-8d2c470a3e03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.371374 Sep 28 15:42:27.255897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 77/156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:26 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:27.275866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.277083 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.277756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.278715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.279616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.280252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.286736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:27.287685 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:27.301500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.302382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.302828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.304502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.305115 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.305546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.483583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:27.491687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ba6356df-5eaf-4d89-86c4-61bd819ba72e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.248822 Sep 28 15:42:27.492705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 80/157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:27 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:27.507795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:27.515372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-db26b3cb-4cc8-4f30-9ea2-4bb7a97c9367 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.232230 Sep 28 15:42:27.516186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 78/158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:27 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:27.816399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69488fec-c032-4a06-aebf-169b15da1e74", "name": "network-vif-plugged", "status": "completed", "tag": "41aaafcb-981e-4fbf-8c80-bbb43167a049"}, {"server_uuid": "c4e20f44-0cc8-40c9-9cf4-c96af23c7e05", "name": "network-vif-plugged", "status": "completed", "tag": "43948096-55d0-43b4-a3ff-177477a90fc2"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:27.827023 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.827501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.827914 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.831830 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:27.841642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] Creating event network-vif-plugged:41aaafcb-981e-4fbf-8c80-bbb43167a049 for instance 69488fec-c032-4a06-aebf-169b15da1e74 on hv-cinder-85931 Sep 28 15:42:27.842331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] Creating event network-vif-plugged:43948096-55d0-43b4-a3ff-177477a90fc2 for instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 on hv-cinder-85931 Sep 28 15:42:27.848702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-38e119f9-bd7c-4cc5-b948-cbec5fcb415c req-4f2a88fb-aa85-4e46-b823-55155fa88da7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035926 Sep 28 15:42:27.849296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 81/159] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:27.881018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:27.881633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:27.889267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.889749 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.890213 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:27.890912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:27.891368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:27.891795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.063183 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:28.076744 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-703fe014-dfd5-42d9-bbb7-1ce6eff01164 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.195177 Sep 28 15:42:28.077530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 79/160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:27 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:28.267211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:28.267973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:28.279122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.279709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.281770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.282026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:28.282693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:28.282853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.283624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.285039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.291826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.292901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.293497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.294978 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.296033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.296392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.596790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:28.605152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e05f9b14-a707-4836-8a34-4e71c2bdb74d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.341719 Sep 28 15:42:28.608335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 82/161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:28 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:28.625951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:28.629285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:28.633753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:28.638317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.639070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.639791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.640937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.641600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.642408 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.650043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7ce2f2fc-8932-4383-920b-a52a76376826 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.372127 Sep 28 15:42:28.651007 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 80/162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:28 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:28.655548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-de3c4096-032f-4e4a-aa0f-58bbbc41a8a8 req-6d0ca7bc-ca4a-4c53-bde5-891f62e9c8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:28.665980 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-de3c4096-032f-4e4a-aa0f-58bbbc41a8a8 req-6d0ca7bc-ca4a-4c53-bde5-891f62e9c8d8 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.667435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-de3c4096-032f-4e4a-aa0f-58bbbc41a8a8 req-6d0ca7bc-ca4a-4c53-bde5-891f62e9c8d8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.668034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-de3c4096-032f-4e4a-aa0f-58bbbc41a8a8 req-6d0ca7bc-ca4a-4c53-bde5-891f62e9c8d8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.684315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-de3c4096-032f-4e4a-aa0f-58bbbc41a8a8 req-6d0ca7bc-ca4a-4c53-bde5-891f62e9c8d8 service nova] Creating event network-changed:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:42:28.691269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-de3c4096-032f-4e4a-aa0f-58bbbc41a8a8 req-6d0ca7bc-ca4a-4c53-bde5-891f62e9c8d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038132 Sep 28 15:42:28.692180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 81/163] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:28.699008 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:28.701212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:28.713068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.714469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.715275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.716037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:28.716922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:28.717510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:28.872588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:28.881095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-68530dea-7d5c-4006-9476-0d4bcea470e5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.267603 Sep 28 15:42:28.883988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 83/164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:28 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:28.914686 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:28.927892 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-db5e6ce7-450b-497d-b97f-6b17eb111b2f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.234174 Sep 28 15:42:28.929025 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 82/165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:28 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:29.102651 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:29.103619 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:29.111085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.112220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.112660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.113367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.114019 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.114444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.250905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:29.259249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b9c96f53-0145-43a2-a780-c9d6ba5a705f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.161288 Sep 28 15:42:29.260919 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 84/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:29 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:29.631490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:29.632862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:29.640119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.640962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.641387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.642100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.642544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.643098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.678299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:29.680795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:29.688501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.689318 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.689998 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.690984 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.692189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.693494 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.901286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:29.909997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:29.913027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-38cbe5a5-b3c0-49fc-9fd7-91033980b620 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.285259 Sep 28 15:42:29.914492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 83/167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:29 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:29.930794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:29.931782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:29.934207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e6c6772c-8b0e-4c95-8848-25f6e2162890 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.259922 Sep 28 15:42:29.934809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 85/168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:29 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:29.938558 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.939216 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.939989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.941045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.941914 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.942482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.953732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:29.954379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:29.961398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.962366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.963031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:29.964547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:29.966511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:29.967153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:30.189429 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:30.197150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-59bca2c8-8817-4607-b2f7-e10327319306 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.281130 Sep 28 15:42:30.197770 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:29 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:30.209147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:30.218634 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e0ddfe4f-1cf2-4af4-8c4c-241d76ad33c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.270147 Sep 28 15:42:30.219205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 86/170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:29 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:30.283508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:30.284425 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:30.291437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:30.292746 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:30.293369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:30.294344 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:30.295102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:30.295626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:30.438624 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:30.447589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0995948d-c553-43ee-824e-b29c26e510de tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.168524 Sep 28 15:42:30.449912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 85/171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:30 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:30.938091 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:30.938702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:30.944558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:30.945040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:30.945476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:30.946197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:30.946655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:30.947084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:30.958377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:30.958377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:30.967595 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:30.967828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:30.968227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:30.969004 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:30.969351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:30.969832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.147046 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:31.156669 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3d76832c-5687-4670-b255-043090c6bf53 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.222547 Sep 28 15:42:31.157927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 87/172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:30 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:31.177820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:31.186080 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3429a650-e339-42d6-b6db-9c44370314b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1367 microversion: 2.1 time: 0.232282 Sep 28 15:42:31.186641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 86/173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:30 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:31.219659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:31.220372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:31.226438 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:31.226918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:31.227349 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.228361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:31.228820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:31.229277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.242626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:31.243505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:31.251138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:31.251790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:31.252227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.252912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:31.253451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:31.253800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.442381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:31.445096 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:31.451569 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3e38a36b-c36e-4121-af9d-651b6341cf24 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.235728 Sep 28 15:42:31.452307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 88/174] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:31 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:31.453244 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b126c305-60e2-4e51-b5af-efe70ba0446b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1362 microversion: 2.1 time: 0.215259 Sep 28 15:42:31.457161 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 87/175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:31 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:31.471079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:31.471682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:31.477739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:31.478255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:31.478683 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.479404 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:31.479856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:31.480273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:31.624355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:31.632545 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-30153135-d8cb-4b9e-a7a6-2cccf6bbfb2f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.165557 Sep 28 15:42:31.633113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 89/176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:31 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:32.179918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.181106 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.188162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.188656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.189092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.190048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.190540 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.191454 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.211285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.212040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.223203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.223802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.234668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.235480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.235975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.236413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.403297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:32.412072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4ef8cf8f-abb8-4640-aa3c-2c88b37de77c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.235965 Sep 28 15:42:32.413331 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 88/177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:32.437010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:32.445092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ec75584a-b677-4807-8c78-f7781ad8b122 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1557 microversion: 2.1 time: 0.238486 Sep 28 15:42:32.445654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 90/178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1557 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:32.470897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.471392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.475534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.476143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.477381 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.477896 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.478341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.479093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.480028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.480442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.483019 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.483511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.483969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.484662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.485118 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.485559 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.622710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5d2a0b2e-149a-4233-8106-59d3bf700159 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155520 Sep 28 15:42:32.623297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 89/179] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:32.628296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.628903 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.635307 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.635796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.636233 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.636932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.637384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.637810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.664570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:32.675344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e882aeea-60ac-492d-905d-813780c29b8c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.204195 Sep 28 15:42:32.676109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 91/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:32.695710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.696316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.704925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.704925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.705160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.705901 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.706358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.706777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.827584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:32.837020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-37f08bbc-919f-4284-82dc-2d87643ce29b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1548 microversion: 2.1 time: 0.212567 Sep 28 15:42:32.842650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 90/181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1548 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:32.862563 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:32.863159 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:32.870021 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.870616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.871172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.871904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:32.872807 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:32.872933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:32.884982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:32.894212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-875716a0-8b59-4340-946b-65429331b81d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1315 microversion: 2.1 time: 0.202137 Sep 28 15:42:32.902856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 92/182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:32.959038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-877bcab0-d9dd-402d-97f7-73f806ce941c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100451 Sep 28 15:42:32.959632 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 91/183] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:42:32 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:33.436545 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:33.437151 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:33.443358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.444070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.444500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:33.445406 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.446073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.446642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:33.666981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-b96ef5ce-298c-4073-9db7-860be6e14265 req-4491df4d-69f1-4d70-af84-5b5a5a4a8a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cb3a9e-72d1-4502-90fe-35576e05e0a2", "tag": "0fdce35c-d94c-4241-8f30-04b6de93d44d"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:33.689713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b96ef5ce-298c-4073-9db7-860be6e14265 req-4491df4d-69f1-4d70-af84-5b5a5a4a8a7b service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.689713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b96ef5ce-298c-4073-9db7-860be6e14265 req-4491df4d-69f1-4d70-af84-5b5a5a4a8a7b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.689713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b96ef5ce-298c-4073-9db7-860be6e14265 req-4491df4d-69f1-4d70-af84-5b5a5a4a8a7b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:33.722992 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-b96ef5ce-298c-4073-9db7-860be6e14265 req-4491df4d-69f1-4d70-af84-5b5a5a4a8a7b service nova] Creating event network-changed:0fdce35c-d94c-4241-8f30-04b6de93d44d for instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 on hv-cinder-85931 Sep 28 15:42:33.732057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-b96ef5ce-298c-4073-9db7-860be6e14265 req-4491df4d-69f1-4d70-af84-5b5a5a4a8a7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071296 Sep 28 15:42:33.733174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 92/184] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:33.741411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:33.742632 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:33.751746 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.752794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.754753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:33.755734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.756395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.757023 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:33.881485 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:33.906031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2bbcf6ea-64b7-49d3-a63e-4bdb1e13aba0 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.473680 Sep 28 15:42:33.906628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 93/185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:33 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:33.921725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:33.922593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:33.931528 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.938602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.940900 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:33.941911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:33.942573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:33.943216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:34.072011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:34.079568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-23969c4c-54f7-4c01-a12c-6526ea51677f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.344859 Sep 28 15:42:34.097074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 93/186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:33 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:34.325698 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:34.338886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9bf2a075-a3d8-4c1a-90ec-c075cc2665cb tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1502 microversion: 2.1 time: 0.425142 Sep 28 15:42:34.339751 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 94/187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:33 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:34.937189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:34.938305 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:34.951436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:34.953688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:34.954799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:34.956675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:34.960588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:34.963419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:35.105070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:35.106622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:35.136811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:35.141626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:35.142102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:35.142836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:35.143314 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:35.143736 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:35.218804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:35.232438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cc86b663-ae0b-4d02-9648-261a7452a181 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.303322 Sep 28 15:42:35.246214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 94/188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:34 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:35.253300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-fe793b71-fc5c-4bc0-9002-c5f291598914 req-6bb9910c-13a4-4233-8dfa-8a935b42b2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac91576-c5d2-418a-a1c5-af43fccf4e46", "tag": "9e5dd716-5edb-44f2-a44f-e25367a21810"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:35.263815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-fe793b71-fc5c-4bc0-9002-c5f291598914 req-6bb9910c-13a4-4233-8dfa-8a935b42b2a1 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:35.267965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-fe793b71-fc5c-4bc0-9002-c5f291598914 req-6bb9910c-13a4-4233-8dfa-8a935b42b2a1 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:35.268590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-fe793b71-fc5c-4bc0-9002-c5f291598914 req-6bb9910c-13a4-4233-8dfa-8a935b42b2a1 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:35.286370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-fe793b71-fc5c-4bc0-9002-c5f291598914 req-6bb9910c-13a4-4233-8dfa-8a935b42b2a1 service nova] Creating event network-changed:9e5dd716-5edb-44f2-a44f-e25367a21810 for instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 on hv-cinder-85931 Sep 28 15:42:35.292360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-fe793b71-fc5c-4bc0-9002-c5f291598914 req-6bb9910c-13a4-4233-8dfa-8a935b42b2a1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044208 Sep 28 15:42:35.293043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 95/189] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:35.455339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:35.465342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e7e26418-22b8-4029-82de-7be0fc8cb881 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.365940 Sep 28 15:42:35.466341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 95/190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:35 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:35.934179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86fdb420-04cb-408e-ba6b-9ab2bc19274a"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:35.936735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:35.943416 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:35.944058 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:35.944480 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:35.945274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:35.945795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:35.946456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:36.262793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:36.264386 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:36.274494 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:36.277378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:36.278775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:36.280339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:36.281693 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:36.285196 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:36.461333 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:36.480573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-33ad514d-d4f0-4b83-b2fd-b2e862b5ec8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1313 microversion: 2.1 time: 0.224025 Sep 28 15:42:36.482554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 96/191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:36 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:36.509689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:36.514039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:36.532970 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:36.533467 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:36.533926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:36.537106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:36.537106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:36.544499 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:36.848888 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:36.857606 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a9ccce57-786c-4e97-8ec5-859f0e7e3aac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1322 microversion: 2.1 time: 0.361195 Sep 28 15:42:36.858213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 97/192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:36 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:37.507123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:37.507760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:37.514279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:37.514846 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:37.515359 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:37.516116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:37.516636 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:37.517062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:37.536071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:37.689732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:37.698249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-aec8f73d-4a7e-4415-ac94-6ab94954f1aa tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1497 microversion: 2.1 time: 0.194412 Sep 28 15:42:37.698802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 98/193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:37 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:37.886353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:37.887618 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:37.894668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:37.895635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:37.896158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:37.896798 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:37.897255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:37.897671 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.063242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:38.071208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d8d4aedb-10a3-4460-b065-5f02b3075fff tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1515 microversion: 2.1 time: 0.190973 Sep 28 15:42:38.071777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 99/194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:37 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:38.095085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:38.097353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:38.104844 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.105339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.105775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.106519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.106975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.107595 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.131630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'flavor' on Instance uuid 69488fec-c032-4a06-aebf-169b15da1e74 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:42:38.228490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:38.303414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-76af652f-6869-4f3e-a3e1-978da3588a5c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74/action" status: 200 len: 32 microversion: 2.1 time: 0.209457 Sep 28 15:42:38.304105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 100/195] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:42:38 2022] POST /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 15:42:38.314376 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:38.315236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:38.323090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.323773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.324726 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.325962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.326721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.327644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.361090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:42:38.482015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-334d0200-61dd-42fd-ba52-f5eb255c1d1d tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "POST /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.551932 Sep 28 15:42:38.483375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 96/196] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:42:35 2022] POST /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be/os-volume_attachments => generated 194 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:38.508386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:38.511370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:38.536442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.537481 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.542102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.543769 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.544560 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.546758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.560576 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-dd2b4be9-9ef0-4d88-8bfa-5588aabb4540 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 204 len: 0 microversion: 2.1 time: 0.254339 Sep 28 15:42:38.561650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 101/197] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:42:38 2022] DELETE /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:42:38.572037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:38.574260 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:38.596478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.597056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.598144 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.598282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:38.598699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:38.606301 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:38.815154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:38.839030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:38.847782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0ecc597d-04c4-4ac5-bac8-892ed506fa9e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.362123 Sep 28 15:42:38.848859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 97/198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:38 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:38.849002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ea8a77bc-9396-4538-a56e-1ef803567269 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1503 microversion: 2.1 time: 0.282099 Sep 28 15:42:38.854623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 102/199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:38 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1503 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:39.872643 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:39.873144 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:39.873509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:39.873675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:39.880272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:39.880748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:39.880932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:39.881179 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:39.881608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:39.881880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:39.882253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:39.882351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:39.882744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:39.883214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:39.883874 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:39.884393 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:40.249364 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:40.258802 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:40.266771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-98c81689-a1a9-47a3-88bf-fb19c6faba2d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.398656 Sep 28 15:42:40.267341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 98/200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:39 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:40.277331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3a6e4115-0d5a-4c34-b886-f8c724479795 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1503 microversion: 2.1 time: 0.402219 Sep 28 15:42:40.278292 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 103/201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:39 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:41.292994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:41.293818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:41.302074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:41.302545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:41.302989 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:41.303190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:41.303967 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:41.304487 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:41.304655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:41.305036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:41.313022 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:41.313984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:41.314734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:41.315933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:41.316615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:41.317613 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:41.719004 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:41.721221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:41.727208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b17162f5-0c66-4516-9cdf-f25dfb42e56d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.439438 Sep 28 15:42:41.727913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 104/202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:41 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:41.730122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e13a6975-def9-4717-a72f-81adde0c1999 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1503 microversion: 2.1 time: 0.433164 Sep 28 15:42:41.730841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 99/203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:41 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:42.030868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-db456b0d-a6f6-4150-acb4-bfad3711fa9e req-69f6b6fc-b05f-4fa9-96c4-af06a8dd5f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e20f44-0cc8-40c9-9cf4-c96af23c7e05", "name": "network-vif-deleted", "tag": "43948096-55d0-43b4-a3ff-177477a90fc2"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:42.058377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-db456b0d-a6f6-4150-acb4-bfad3711fa9e req-69f6b6fc-b05f-4fa9-96c4-af06a8dd5f24 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:42.058912 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-db456b0d-a6f6-4150-acb4-bfad3711fa9e req-69f6b6fc-b05f-4fa9-96c4-af06a8dd5f24 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:42.059361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-db456b0d-a6f6-4150-acb4-bfad3711fa9e req-69f6b6fc-b05f-4fa9-96c4-af06a8dd5f24 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:42.071452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-db456b0d-a6f6-4150-acb4-bfad3711fa9e req-69f6b6fc-b05f-4fa9-96c4-af06a8dd5f24 service nova] Creating event network-vif-deleted:43948096-55d0-43b4-a3ff-177477a90fc2 for instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 on hv-cinder-85931 Sep 28 15:42:42.078040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-db456b0d-a6f6-4150-acb4-bfad3711fa9e req-69f6b6fc-b05f-4fa9-96c4-af06a8dd5f24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053953 Sep 28 15:42:42.082946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 105/204] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:42:42.751605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:42.752306 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:42.759109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:42.759607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:42.760041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:42.760935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:42.761548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:42.762001 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:42.763376 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:42.764561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:42.770699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:42.771171 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:42.771872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:42.772568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:42.773016 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:42.773433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:42.807575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:42.808052 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:42.808483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:42.808915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lazy-loading 'fault' on Instance uuid c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:42:42.865095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:42.875060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-73e2bd7a-cb62-4985-9d3e-f4cca34b0b77 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 200 len: 1303 microversion: 2.1 time: 0.116518 Sep 28 15:42:42.876414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 106/205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:42 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:42.944443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:42.952108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a991f0d7-ca77-4054-bdfd-e7315e4d4e6b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.204570 Sep 28 15:42:42.952673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 100/206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:42 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:43.899929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:43.900537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: c4e20f44-0cc8-40c9-9cf4-c96af23c7e05] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:43.908309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:43.909071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:43.909324 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:43.910524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:43.911054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:43.911760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:43.925225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] HTTP exception thrown: Instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 could not be found. Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Request method failure captured: Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 HTTP/1.1 Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGtHPEosjxqUcmTQAJZxYw9l2HnaCAoaJZDVBBdvdVPQvw1lJajhnxNkh87Va9bvAlETvsFF5MIqYcsIqyRyPpdRUeQ3BkGQCyhl6wR3nYh4pMinnSl5tpxx16o6lyxiWdBPWcQe9OS9J-TaCKenmFXVV4yc0-6XebtEVyFgkJaxkYU Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: f9b4928b5e2d4f6286e8e56d35c813a9 Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesActionsTest-354295978 Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:42:43.933457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b4928b5e2d4f6286e8e56d35c813a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b4928b5e2d4f6286e8e56d35c813a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b4928b5e2d4f6286e8e56d35c813a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b4928b5e2d4f6286e8e56d35c813a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesActionsTest-354295978 Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: f9b4928b5e2d4f6286e8e56d35c813a9 Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesActionsTest-354295978 Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesActionsTest-354295978-project Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 5558f9c2bb37403b9ff03f2be1aa3113 Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesActionsTest-354295978-project Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 could not be found. Sep 28 15:42:43.934974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'c4e20f44-0cc8-40c9-9cf4-c96af23c7e05'} Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 could not be found. Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:42:43.935775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 could not be found. Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 could not be found. Sep 28 15:42:43.937060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:42:43.938182 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Returning 404 to user: Instance c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:42:43.938182 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2c3d1309-2ba4-45ad-837d-603d9abafc2b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05" status: 404 len: 111 microversion: 2.1 time: 0.039613 Sep 28 15:42:43.939571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 107/207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:43 2022] GET /compute/v2.1/servers/c4e20f44-0cc8-40c9-9cf4-c96af23c7e05 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:42:43.978659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:43.979488 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:43.986605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:43.987012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:43.987646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:43.988341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:43.988789 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:43.989206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:44.055313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-879504010", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "networks": [{"uuid": "84f80fdf-b0dd-46dc-8fee-113483d41db6"}]}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:44.123149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] validate_networks() for [('84f80fdf-b0dd-46dc-8fee-113483d41db6', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:42:44.220236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:44.227908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d9e1631a-d816-4c13-b410-624eeda3dbf2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.253135 Sep 28 15:42:44.229885 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 101/208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:43 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:44.527071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:42:44.527579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:42:44.528157 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:42:44.528635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:42:44.529121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:42:44.532627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:44.546933 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:44.547429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:44.547869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:44.548603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:44.549056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:44.549501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:44.573666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Getting quotas for project f9b4928b5e2d4f6286e8e56d35c813a9. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:42:44.578499 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Getting quotas for user 5558f9c2bb37403b9ff03f2be1aa3113 and project f9b4928b5e2d4f6286e8e56d35c813a9. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:42:44.592117 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:42:44.594492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:42:44.646718 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-44ed554b-dd0e-4191-8b2f-25e35c202395 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595577 Sep 28 15:42:44.647638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 108/209] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:42:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:42:44.659538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-87f0d2aa-577b-4186-be8d-91946fa56db2 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:44.660457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-87f0d2aa-577b-4186-be8d-91946fa56db2 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:44.749119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-87f0d2aa-577b-4186-be8d-91946fa56db2 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:44.759254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-87f0d2aa-577b-4186-be8d-91946fa56db2 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1213 microversion: 2.1 time: 0.103454 Sep 28 15:42:44.775608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 102/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:44 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:45.253777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.254645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:45.262640 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:45.263203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:45.263635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:45.264579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:45.265036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:45.265702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:45.423856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:45.432283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-11f7a962-e7a1-442f-a5f9-8a68fa4e8f74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.182348 Sep 28 15:42:45.433098 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 109/211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:45 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:45.782666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:45.783397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:45.789578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:45.790091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:45.790645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:45.791839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:45.792288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:45.792705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:45.860481 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:45.868398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3d207ef4-265f-4e00-8da9-52fa8c2f77b8 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1265 microversion: 2.1 time: 0.089684 Sep 28 15:42:45.869524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 103/212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:45 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:46.455966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:46.456648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:46.462870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:46.463428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:46.463923 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:46.464808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:46.465533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:46.465895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:46.615226 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:46.625922 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a760fcb5-005f-4dc0-a1e7-dc1827621acc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.173586 Sep 28 15:42:46.627303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 110/213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:46 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:46.891299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:46.891995 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:46.898562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:46.899041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:46.899470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:46.900689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:46.901153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:46.901574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:46.965540 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:46.973182 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-acc3b377-3523-4363-86ac-788a01b20e9e tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1273 microversion: 2.1 time: 0.085948 Sep 28 15:42:46.973747 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 104/214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:46 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:47.649776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:47.650432 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:47.656745 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:47.657225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:47.657655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:47.658379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:47.658996 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:47.659420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:47.795964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:47.803562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-511ff98d-2727-4ca5-91d6-a70fde4fe675 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.157710 Sep 28 15:42:47.804120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 111/215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:47 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:47.997898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:47.998501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:48.005081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:48.005559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:48.006014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:48.006702 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:48.007147 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:48.007565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:48.076672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:48.084663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ccdb90ac-a769-4459-951a-ed93af3a40f6 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1273 microversion: 2.1 time: 0.091510 Sep 28 15:42:48.085235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 105/216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:47 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:48.835133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:48.838062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:48.846532 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:48.847242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:48.847897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:48.849011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:48.850080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:48.850754 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:49.061026 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:49.068861 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2ebe1d53-745c-4324-aa02-f6ffa4a27cb0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.243805 Sep 28 15:42:49.069443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 112/217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:48 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:49.108732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:49.109337 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:49.117378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:49.117887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:49.119109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:49.120031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:49.120669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:49.121274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:49.347751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:49.359949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e0a5e9d1-1a14-4586-8c7b-d01d55f7f049 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.255115 Sep 28 15:42:49.374677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 106/218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:49 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:49.878775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:49.879270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:49.885821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:49.886551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:49.887136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:49.887990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:49.888592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:49.889164 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:49.914174 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:49.920266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-aacc102f-c76f-4266-a41b-d150361eb841 req-94ae6bf5-7d5a-4858-bba7-6410a0ef644f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0", "tag": "bdc47771-d34a-4f68-a2e8-32f1a46158ef"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:49.920518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:42:49.945523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-aacc102f-c76f-4266-a41b-d150361eb841 req-94ae6bf5-7d5a-4858-bba7-6410a0ef644f service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:49.946043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-aacc102f-c76f-4266-a41b-d150361eb841 req-94ae6bf5-7d5a-4858-bba7-6410a0ef644f service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:49.946474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-aacc102f-c76f-4266-a41b-d150361eb841 req-94ae6bf5-7d5a-4858-bba7-6410a0ef644f service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:49.974724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-aacc102f-c76f-4266-a41b-d150361eb841 req-94ae6bf5-7d5a-4858-bba7-6410a0ef644f service nova] Creating event network-changed:bdc47771-d34a-4f68-a2e8-32f1a46158ef for instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 on hv-cinder-85931 Sep 28 15:42:49.987125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-aacc102f-c76f-4266-a41b-d150361eb841 req-94ae6bf5-7d5a-4858-bba7-6410a0ef644f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073081 Sep 28 15:42:49.988225 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 107/219] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:50.044742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b620afba-d316-451b-8c09-d06f69f7db8c tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 204 len: 0 microversion: 2.1 time: 0.168996 Sep 28 15:42:50.046846 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 113/220] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:42:49 2022] DELETE /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:42:50.054935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:50.055789 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:50.062173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:50.062660 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:50.063117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:50.063978 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:50.064435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:50.064853 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:50.093501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:50.094278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:50.100105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:50.100587 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:50.101016 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:50.101701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:50.102184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:50.102603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:50.241098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:50.249214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b210c66d-8934-4f6a-b2e1-d848a55e944f tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.198646 Sep 28 15:42:50.250055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 108/221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:50 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:50.273834 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:50.282151 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6274123d-5358-4507-8c93-cd551889600c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.192820 Sep 28 15:42:50.282844 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 114/222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:50 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:50.385387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:50.386023 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:50.391902 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:50.392377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:50.392804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:50.393485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:50.394071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:50.394499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:50.526950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:50.534638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bdab729c-6f2e-4963-9bf5-4d718e46faa1 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.153631 Sep 28 15:42:50.535203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 109/223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:50 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:51.275254 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:51.276490 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:51.282889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:51.283515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:51.284030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:51.284713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:51.285162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:51.285650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:51.306504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:51.307125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:51.313536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:51.314057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:51.314496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:51.315197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:51.315650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:51.316133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:51.492558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:51.501454 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5658d293-5443-4fbc-b3dc-d0b00dfeaba0 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.230441 Sep 28 15:42:51.502061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 115/224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:51 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:51.526389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:51.534287 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-82c3f006-520f-478d-8b09-2f8fe6d5256f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.232266 Sep 28 15:42:51.534866 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 110/225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:51 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:51.556831 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:51.557437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:51.563440 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:51.563923 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:51.564361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:51.565047 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:51.565497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:51.565947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:51.697348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:51.704982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-91c4c6af-d3d0-43a4-ad53-986f22c81315 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.151927 Sep 28 15:42:51.705472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 116/226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:51 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:52.524749 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:52.525123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:52.531459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:52.531934 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:52.532360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:52.533055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:52.533505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:52.533947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:52.559099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:52.559926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:52.566080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:52.566680 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:52.567204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:52.567986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:52.568537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:52.569052 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:52.723411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:52.732219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-42a2be0b-9e11-4fc5-9ae2-41f07f6b0be6 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.211655 Sep 28 15:42:52.732985 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 111/227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:52 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:52.737130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:52.737728 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:52.740850 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:52.743511 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:52.743987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:52.744413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:52.745094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:52.745538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:52.745973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:52.749645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7d3b3063-397d-4351-a6a1-d3b4cbd90802 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.195456 Sep 28 15:42:52.750248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 117/228] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:52 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:52.871862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:52.879601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1ca134f9-5927-4881-9e53-c0374f19c93a tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.145909 Sep 28 15:42:52.880156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 112/229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:52 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:53.756107 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:53.756716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:53.763357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:53.763832 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:53.764258 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:53.764940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:53.765394 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:53.765874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:53.772221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:53.772807 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:53.779439 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:53.779914 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:53.780336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:53.781017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:53.781463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:53.781896 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:53.946063 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:53.954190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-be39f296-5e50-4ccb-8878-5434e44e845a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.201925 Sep 28 15:42:53.954761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 118/230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:53 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:53.959208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:53.959811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:53.965506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:53.966092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:53.966696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:53.967395 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:53.967498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:53.967848 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:53.968272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:53.975777 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6523dd01-deed-46f3-88e3-fcc5f3fd5ea6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.207302 Sep 28 15:42:53.976413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 113/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:53 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:54.097172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:54.105237 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-531c66a5-2378-4796-b9b2-915179a3fd7d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.149546 Sep 28 15:42:54.105794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 119/232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:53 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:54.977658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:54.978319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:54.980612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:54.986872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:54.987393 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:54.987831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:54.988539 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:54.988983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:54.989406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:54.994977 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:55.001051 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:55.001667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:55.003686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:55.004369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:55.010383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:55.011472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:55.011472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:55.012140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:55.012588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:55.013044 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:55.219198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:55.227297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f4f66e84-48ae-4044-bdad-804ea8361b52 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.253500 Sep 28 15:42:55.243104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 114/233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:54 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:55.243104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:55.243104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:55.243104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:55.243104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:55.244240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:55.244240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:55.244370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:55.244874 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:55.245276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:55.255744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a6c41abc-9a5b-4f8c-83a3-8563289ee8e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.259151 Sep 28 15:42:55.256331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 120/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:54 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:55.380263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:55.388162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3f85c23e-d879-4ba6-a540-5a0e9bee8f68 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.159234 Sep 28 15:42:55.388722 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 115/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:55 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:56.250930 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:56.251481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:56.257335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:56.257806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:56.258261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:56.259434 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:56.259887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:56.260307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:56.279676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:56.280279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:56.282690 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=85 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:42:56.287965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:56.288457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:56.288888 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:56.289596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:56.292618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:56.293070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:56.434407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:56.442562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-77d23368-8785-4ba5-81b4-319fedf63500 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.195842 Sep 28 15:42:56.443218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 121/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:56 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:56.448136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:56.448815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:56.454428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:56.454904 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:56.455329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:56.456017 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:56.456465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:56.456892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:56.464468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:56.472879 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e5764b5a-05bc-48f3-a81d-8ca3c7cd42da tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.197020 Sep 28 15:42:56.474006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 116/237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:56 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:56.585547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:56.593538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a0bf27e9-5709-47af-bd0e-5b8597d5c1ce tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.149267 Sep 28 15:42:56.594153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 122/238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:56 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:57.466200 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:57.466815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:57.473261 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:57.473739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:57.474415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:57.475191 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:57.475650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:57.476289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:57.498875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:57.499882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:57.505928 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:57.506529 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:57.506857 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:57.507560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:57.508020 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:57.508444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.062968 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:58.072939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-813981d4-eed3-4937-8e04-f02c699b3fbe tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1554 microversion: 2.1 time: 0.611058 Sep 28 15:42:58.073771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 117/239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:57 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1554 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:58.079234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:58.080104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:58.086998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.087850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.088568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.089478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.090161 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.090786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.138859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:58.151013 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1a5ca8fc-ed69-4af6-aa56-2c3e2d978a0d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.656778 Sep 28 15:42:58.152321 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 123/240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:57 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:42:58.425566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-73e75974-66f6-4345-9b48-994888249dd6 req-cb6ad691-b846-44ad-b6b0-b8526dc98fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be", "name": "network-vif-deleted", "tag": "ee69f789-a694-42a3-869d-d84a727eae15"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:42:58.434616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:58.444653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4709e0bb-35a6-46a5-9b5c-f3dbbf49ee88 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.369464 Sep 28 15:42:58.445231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 118/241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:58 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:58.448537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-73e75974-66f6-4345-9b48-994888249dd6 req-cb6ad691-b846-44ad-b6b0-b8526dc98fc7 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:58.449036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-73e75974-66f6-4345-9b48-994888249dd6 req-cb6ad691-b846-44ad-b6b0-b8526dc98fc7 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:58.449482 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-73e75974-66f6-4345-9b48-994888249dd6 req-cb6ad691-b846-44ad-b6b0-b8526dc98fc7 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:58.468807 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-73e75974-66f6-4345-9b48-994888249dd6 req-cb6ad691-b846-44ad-b6b0-b8526dc98fc7 service nova] Creating event network-vif-deleted:ee69f789-a694-42a3-869d-d84a727eae15 for instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be on hv-cinder-85931 Sep 28 15:42:58.474287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-73e75974-66f6-4345-9b48-994888249dd6 req-cb6ad691-b846-44ad-b6b0-b8526dc98fc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055338 Sep 28 15:42:58.475556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 124/242] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:42:59.112255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:59.112862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:59.119113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.119588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.120021 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.120730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.121179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.121599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.154273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.154751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.155179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.155685 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lazy-loading 'fault' on Instance uuid a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:42:59.181110 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:59.181809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:59.193240 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.193734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.194380 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.196667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.197545 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.198331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.215272 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922e0b1b4717422abb6f4e93ea15a86d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6822e0b3eedd404895cd4c0c64082344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:59.224308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4205e1bb-e2e1-4205-97ca-33ea856c2052 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 200 len: 1351 microversion: 2.1 time: 0.115768 Sep 28 15:42:59.224999 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 119/243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:59 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:59.339460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:59.347856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f481b785-36b7-40a3-a11f-987030e6ddd4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.170890 Sep 28 15:42:59.349197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 125/244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:59 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:42:59.470737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:42:59.471446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:42:59.477759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.478496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.478929 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.479641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:42:59.480095 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:42:59.480512 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:42:59.685492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:42:59.695039 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-332a15d8-5616-4c6f-9401-e3bad5431d50 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.227731 Sep 28 15:42:59.713052 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 120/245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:42:59 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:00.249957 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:00.250719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:00.256893 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.257372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.257801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.258514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.259603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.260023 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.277568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] HTTP exception thrown: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Request method failure captured: Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be HTTP/1.1 Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs3PoCMt12NMhSOmvRl9tSSEmU5FiBA_FVK3fomYUCjbuvdPLK8mwoInKiN0yruRukLIFJPQBrjKHs2aUvPxuu3kBQFpBF4Ps65cSjbZqwSQxsHCe5zWNPpabite0pFcQeX3_ibLOUCzyOfhtygnrz81HGT0j0mEa2xigwaz76CpAU Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:43:00.279416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6822e0b3eedd404895cd4c0c64082344", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 922e0b1b4717422abb6f4e93ea15a86d Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.280638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be'} Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:43:00.281335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.282478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.283437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Returning 404 to user: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:43:00.283437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d3282f04-33f8-47eb-b3b8-3609a96d7c3e tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 404 len: 111 microversion: 2.1 time: 0.036192 Sep 28 15:43:00.283437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 126/246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:00 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:43:00.371467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:00.372100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:00.380225 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.380702 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.381130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.381817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.382474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.382737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.403968 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:00.406290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:00.413279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.414459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.415145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.416024 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.417196 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.417802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.555033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:00.566369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9ee28034-7b10-45d3-ab37-e99ead815485 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.198966 Sep 28 15:43:00.579371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 121/247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:00 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:00.598494 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] HTTP exception thrown: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Request method failure captured: Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be/os-volume_attachments HTTP/1.1 Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs3PoCMt12NMhSOmvRl9tSSEmU5FiBA_FVK3fomYUCjbuvdPLK8mwoInKiN0yruRukLIFJPQBrjKHs2aUvPxuu3kBQFpBF4Ps65cSjbZqwSQxsHCe5zWNPpabite0pFcQeX3_ibLOUCzyOfhtygnrz81HGT0j0mEa2xigwaz76CpAU Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:43:00.600065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6822e0b3eedd404895cd4c0c64082344", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 922e0b1b4717422abb6f4e93ea15a86d Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.601246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'server_id': 'a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be'} Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:43:00.601945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:00.606875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:00.608568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Returning 404 to user: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:43:00.608568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ac02d6ff-51a1-4c68-a125-638888d73ff5 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.201415 Sep 28 15:43:00.608568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 127/248] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:43:00 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be/os-volume_attachments => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:43:00.720988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:00.721613 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:00.730170 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.730664 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.731248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.732087 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:00.732419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:00.734124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:00.945017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:00.955419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8cf34c91-a2e4-45da-b080-43cd279faab3 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.238417 Sep 28 15:43:00.956489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 122/249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:00 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:01.030668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-8d3d29c8-1d74-48fd-bfba-3c340258fad0 req-8d33bae5-8508-4a02-ad20-1f23d9669ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0", "name": "network-vif-plugged", "status": "completed", "tag": "bdc47771-d34a-4f68-a2e8-32f1a46158ef"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:01.050427 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-8d3d29c8-1d74-48fd-bfba-3c340258fad0 req-8d33bae5-8508-4a02-ad20-1f23d9669ee2 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.052833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-8d3d29c8-1d74-48fd-bfba-3c340258fad0 req-8d33bae5-8508-4a02-ad20-1f23d9669ee2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.054318 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-8d3d29c8-1d74-48fd-bfba-3c340258fad0 req-8d33bae5-8508-4a02-ad20-1f23d9669ee2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.086156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-8d3d29c8-1d74-48fd-bfba-3c340258fad0 req-8d33bae5-8508-4a02-ad20-1f23d9669ee2 service nova] Creating event network-vif-plugged:bdc47771-d34a-4f68-a2e8-32f1a46158ef for instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 on hv-cinder-85931 Sep 28 15:43:01.093880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-8d3d29c8-1d74-48fd-bfba-3c340258fad0 req-8d33bae5-8508-4a02-ad20-1f23d9669ee2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068242 Sep 28 15:43:01.094574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 128/250] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:01.592428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:01.593774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:01.600586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.601071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.601502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.603296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.604249 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.604830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.757384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:01.766370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-353f6700-7f75-4b2e-a44b-32bd870d6846 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.178443 Sep 28 15:43:01.767396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 123/251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:01 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:01.896329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:01.897333 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:01.904310 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.904830 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.905270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.906003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.906460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.906886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.925688 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] HTTP exception thrown: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Request method failure captured: Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be HTTP/1.1 Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs3PoCMt12NMhSOmvRl9tSSEmU5FiBA_FVK3fomYUCjbuvdPLK8mwoInKiN0yruRukLIFJPQBrjKHs2aUvPxuu3kBQFpBF4Ps65cSjbZqwSQxsHCe5zWNPpabite0pFcQeX3_ibLOUCzyOfhtygnrz81HGT0j0mEa2xigwaz76CpAU Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:43:01.927387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6822e0b3eedd404895cd4c0c64082344", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 922e0b1b4717422abb6f4e93ea15a86d Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.928615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be'} Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:43:01.929289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.930480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.931570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Returning 404 to user: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:43:01.931570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0e238ee4-6c71-4c0c-b127-9b50206d0638 tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 404 len: 111 microversion: 2.1 time: 0.036801 Sep 28 15:43:01.931570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 129/252] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:43:01 2022] DELETE /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:43:01.938130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:01.938899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] [instance: a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:01.944840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.945321 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.946033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.947663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.948121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.948547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.963295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] HTTP exception thrown: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Request method failure captured: Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be HTTP/1.1 Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs3PoCMt12NMhSOmvRl9tSSEmU5FiBA_FVK3fomYUCjbuvdPLK8mwoInKiN0yruRukLIFJPQBrjKHs2aUvPxuu3kBQFpBF4Ps65cSjbZqwSQxsHCe5zWNPpabite0pFcQeX3_ibLOUCzyOfhtygnrz81HGT0j0mEa2xigwaz76CpAU Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:43:01.968032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6822e0b3eedd404895cd4c0c64082344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6822e0b3eedd404895cd4c0c64082344", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 6822e0b3eedd404895cd4c0c64082344 Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-DeleteServersTestJSON-1352244844 Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 922e0b1b4717422abb6f4e93ea15a86d Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-DeleteServersTestJSON-1352244844-project Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.969214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': 'a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be'} Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:43:01.969940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. Sep 28 15:43:01.971269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:01.972240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] Returning 404 to user: Instance a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:43:01.972240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c186ec96-2766-4bf1-bc70-8fecf14e8f1a tempest-DeleteServersTestJSON-1352244844 tempest-DeleteServersTestJSON-1352244844-project] 10.222.0.52 "GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be" status: 404 len: 111 microversion: 2.1 time: 0.035566 Sep 28 15:43:01.981534 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 124/253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:01 2022] GET /compute/v2.1/servers/a0e52b94-b4ab-4a07-9bf6-9a1c15dec3be => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:43:01.983070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:01.983885 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:01.992087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.992575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.993177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:01.994034 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:01.994492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:01.994911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:02.269006 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:02.283612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a8424211-6e82-416e-bfb7-2788274f9b8b tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1313 microversion: 2.1 time: 0.308181 Sep 28 15:43:02.286445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 130/254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:01 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:02.789956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:02.790566 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:02.796816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:02.797480 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:02.797939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:02.798811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:02.799257 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:02.799850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.008785 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:03.016813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c43e1a09-d85c-4807-b39c-f1d577638209 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.230657 Sep 28 15:43:03.017536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 125/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:02 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:03.317007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:03.317799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:03.326827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:03.327374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:03.327781 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.328828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:03.329297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:03.329972 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:03.360100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:03.575082 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:03.590399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8d71a1ce-4cee-4638-b3ec-99eaa65cd7e9 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1497 microversion: 2.1 time: 0.280053 Sep 28 15:43:03.591459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 131/256] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:03 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1497 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:04.039882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:04.041128 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:04.050008 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.050762 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.051419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.052436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.053139 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.053884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.214494 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:04.214996 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:04.223456 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.224189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.224791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.225646 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.226917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.227577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.269132 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:43:04.332335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:04.341262 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9f513544-8783-4b44-9557-3aa251357d75 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.305406 Sep 28 15:43:04.342392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 126/257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:04 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:04.405739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-364d59a4-3e12-414a-b4b1-cd8f0f2fac3c tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 204 len: 0 microversion: 2.1 time: 0.196218 Sep 28 15:43:04.410264 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 132/258] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:43:04 2022] DELETE /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:43:04.419769 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:04.420672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:04.428987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.429785 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.431065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.431952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:04.432588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:04.433883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:04.607907 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:04.620994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8788b37f-9a00-4aa2-89c3-0d22aaa71422 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1503 microversion: 2.1 time: 0.208619 Sep 28 15:43:04.621562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 127/259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:04 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:05.368945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:05.370011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:05.377080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:05.377776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:05.378403 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:05.379463 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:05.380094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:05.380681 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:05.646910 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:05.646910 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:05.659203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:05.659911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:05.660498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:05.662489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:05.663102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:05.663735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:06.025285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:06.034053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8364c5e3-6ff3-441d-af6a-5392e216d9ea tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.671979 Sep 28 15:43:06.034627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 133/260] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:05 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:06.183736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:06.191462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0706ca93-ac90-4a15-884f-0c5b83e91775 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1503 microversion: 2.1 time: 0.551500 Sep 28 15:43:06.200185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 128/261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:05 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:07.019203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-7a63c0ef-de90-4150-8539-b30a689cf326 req-86291cab-852a-40c5-a64b-98d07d8c41ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0", "name": "network-vif-deleted", "tag": "bdc47771-d34a-4f68-a2e8-32f1a46158ef"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:07.033923 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-7a63c0ef-de90-4150-8539-b30a689cf326 req-86291cab-852a-40c5-a64b-98d07d8c41ad service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.040409 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-7a63c0ef-de90-4150-8539-b30a689cf326 req-86291cab-852a-40c5-a64b-98d07d8c41ad service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.040865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-7a63c0ef-de90-4150-8539-b30a689cf326 req-86291cab-852a-40c5-a64b-98d07d8c41ad service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.060354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:07.060913 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:07.074905 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.075393 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.075828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.076609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.077010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.077434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.091018 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-7a63c0ef-de90-4150-8539-b30a689cf326 req-86291cab-852a-40c5-a64b-98d07d8c41ad service nova] Creating event network-vif-deleted:bdc47771-d34a-4f68-a2e8-32f1a46158ef for instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 on hv-cinder-85931 Sep 28 15:43:07.102534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-7a63c0ef-de90-4150-8539-b30a689cf326 req-86291cab-852a-40c5-a64b-98d07d8c41ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086840 Sep 28 15:43:07.141926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 134/262] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:07.217766 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:07.227951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:07.237737 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.240949 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.243195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.244166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:07.247080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:07.247538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:07.381291 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5558f9c2bb37403b9ff03f2be1aa3113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9b4928b5e2d4f6286e8e56d35c813a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:07.391177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-991c56f0-c9c8-4b6f-b5d3-033501299b63 tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 200 len: 1298 microversion: 2.1 time: 0.177520 Sep 28 15:43:07.392075 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 135/263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:07 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 1298 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:07.435453 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:07.446550 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4517b9a5-682f-4860-8f9f-29297f575407 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.390157 Sep 28 15:43:07.447644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 129/264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:07 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:08.415735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:08.417323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] [instance: a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:08.430114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.430620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.438151 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.439207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.439889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.440424 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.459440 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] HTTP exception thrown: Instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 could not be found. Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Request method failure captured: Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 HTTP/1.1 Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGtHPEosjxqUcmTQAJZxYw9l2HnaCAoaJZDVBBdvdVPQvw1lJajhnxNkh87Va9bvAlETvsFF5MIqYcsIqyRyPpdRUeQ3BkGQCyhl6wR3nYh4pMinnSl5tpxx16o6lyxiWdBPWcQe9OS9J-TaCKenmFXVV4yc0-6XebtEVyFgkJaxkYU Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: f9b4928b5e2d4f6286e8e56d35c813a9 Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesActionsTest-354295978 Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:43:08.462039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b4928b5e2d4f6286e8e56d35c813a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9b4928b5e2d4f6286e8e56d35c813a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9b4928b5e2d4f6286e8e56d35c813a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9b4928b5e2d4f6286e8e56d35c813a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesActionsTest-354295978 Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: f9b4928b5e2d4f6286e8e56d35c813a9 Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesActionsTest-354295978 Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesActionsTest-354295978-project Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 5558f9c2bb37403b9ff03f2be1aa3113 Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesActionsTest-354295978-project Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 could not be found. Sep 28 15:43:08.463498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0'} Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 could not be found. Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:43:08.464411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 could not be found. Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 could not be found. Sep 28 15:43:08.466102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:43:08.472720 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:08.473462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:08.478236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] Returning 404 to user: Instance a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:43:08.479398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-72672c1f-1f11-4250-8941-72d6f0f4b32d tempest-VolumesActionsTest-354295978 tempest-VolumesActionsTest-354295978-project] 10.222.0.52 "GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0" status: 404 len: 111 microversion: 2.1 time: 0.067766 Sep 28 15:43:08.480254 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 136/265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:08 2022] GET /compute/v2.1/servers/a7a3b1bf-13a8-45f9-92dd-21f6b1cbc6c0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:43:08.481711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.482402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.489503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.489503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:08.489503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:08.489503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:08.666398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:08.674933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-17729b94-f230-4df5-852a-d22e3a246b12 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.206655 Sep 28 15:43:08.687044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 130/266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:08 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:09.585971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7c4879b7-cb5c-4fd5-9c1d-c225e9ba4460 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f11550e8940>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:09.635315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7c4879b7-cb5c-4fd5-9c1d-c225e9ba4460 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d29b9923-91c4-4140-a1a6-af431379bcb6" status: 200 len: 351 microversion: 2.1 time: 0.053274 Sep 28 15:43:09.635958 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 137/267] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:43:09 2022] GET /compute/v2.1/os-volumes/d29b9923-91c4-4140-a1a6-af431379bcb6 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:09.700243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:09.701448 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:09.709057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:09.709766 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:09.710286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:09.711046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:09.712125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:09.712609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:09.716779 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:09.863222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:09.871510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-686df432-2349-4938-9ac2-9d865138b68b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.174979 Sep 28 15:43:09.872230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 131/268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:09 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:10.895113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:10.895803 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:10.902388 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:10.902955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:10.903454 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:10.904213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:10.904737 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:10.905230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:11.045036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:11.055555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-dffebafb-db11-427d-b959-e4012a13c24d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.164140 Sep 28 15:43:11.056242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 138/269] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:10 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:12.078488 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:12.079097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:12.085654 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:12.086169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:12.086627 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:12.087310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:12.087756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:12.088172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:12.219676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:12.228273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4ca03f0e-700b-42e5-8aec-6afe2e561f8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.153562 Sep 28 15:43:12.228837 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 132/270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:12 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:13.130525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b472fc0b-b062-4931-9e08-f8f7ff9780f9 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f11550c6280>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:13.177236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b472fc0b-b062-4931-9e08-f8f7ff9780f9 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3c5360cd-a6f8-4b9a-9af0-8cd5b0c76893" status: 200 len: 350 microversion: 2.1 time: 0.050446 Sep 28 15:43:13.177791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 139/271] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:43:13 2022] GET /compute/v2.1/os-volumes/3c5360cd-a6f8-4b9a-9af0-8cd5b0c76893 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:13.250684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:13.251283 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:13.257731 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:13.258788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:13.259219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:13.260253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:13.260697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:13.261110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:13.406216 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:13.432770 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cd36a8b6-5c68-44ce-8bfe-381a0f82c8f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.186042 Sep 28 15:43:13.446074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 133/272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:13 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:14.457959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:14.458464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:14.468120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:14.469449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:14.472702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:14.473779 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:14.475514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:14.478993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:14.556699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ce6bb973-a79c-4aa8-b506-e3209ac06697 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1155279280>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:14.675800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ce6bb973-a79c-4aa8-b506-e3209ac06697 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/dc26d137-2c12-4158-b9f5-a2072275b85f" status: 200 len: 350 microversion: 2.1 time: 0.123815 Sep 28 15:43:14.677451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 134/273] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/os-volumes/dc26d137-2c12-4158-b9f5-a2072275b85f => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:14.691385 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-584e6df7-d951-45cc-a731-7aa2d3a698f3 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1155111790>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:14.776696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:14.784511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1fea1b4c-8551-41ca-97aa-0d0a049a7f11 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.331208 Sep 28 15:43:14.785073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 140/274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:14.805953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-584e6df7-d951-45cc-a731-7aa2d3a698f3 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.118923 Sep 28 15:43:14.806612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 135/275] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:14.822209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cc7d9eef-173e-496f-b810-b6f5247d3434 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f11551380d0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:14.922353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cc7d9eef-173e-496f-b810-b6f5247d3434 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.104472 Sep 28 15:43:14.922920 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 141/276] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:14.939477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-88ec9bec-11e1-45a0-9260-e0eb6572c11b tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1154ffcdc0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.059584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-88ec9bec-11e1-45a0-9260-e0eb6572c11b tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.124619 Sep 28 15:43:15.066310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 136/277] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Sep 28 15:43:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:15.073825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b95d7eb9-10b9-4c88-a619-991e29a62dc8 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1154fc3280>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.173618 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b95d7eb9-10b9-4c88-a619-991e29a62dc8 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104009 Sep 28 15:43:15.174785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 142/278] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:15.189793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6354b3bc-b4a0-4dfe-b6bd-820656b8008d tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1154ffc550>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.282795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6354b3bc-b4a0-4dfe-b6bd-820656b8008d tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096944 Sep 28 15:43:15.283700 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 137/279] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:15.301449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-32a821ef-b54a-4b0a-8677-73c1cff32223 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f11552941f0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.402130 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-32a821ef-b54a-4b0a-8677-73c1cff32223 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.107889 Sep 28 15:43:15.410323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 143/280] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:15.417193 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f87b8be0-ba6a-479a-a055-b46f9ca39cc8 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1155111310>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.522168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f87b8be0-ba6a-479a-a055-b46f9ca39cc8 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.109544 Sep 28 15:43:15.522786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 138/281] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:43:15.536826 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2e888d7a-49a5-4dae-85b6-730572420293 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] Calling method '.version_select at 0x7f1154fc3c10>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.625348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2e888d7a-49a5-4dae-85b6-730572420293 tempest-VolumesTestJSON-620527989 tempest-VolumesTestJSON-620527989-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092251 Sep 28 15:43:15.626666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 144/282] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:15.810309 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:15.811765 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:15.820219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:15.820872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:15.821493 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:15.822597 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:15.823131 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:15.823857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:15.987617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:15.997234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fa567d11-2e79-4fae-b08b-785ab1e8c30f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.192852 Sep 28 15:43:15.997803 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 139/283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:15 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:17.025315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:17.027335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:17.040416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:17.042579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:17.043073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:17.043511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:17.044221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:17.044676 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:17.045186 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:17.204190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:17.212823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0c25b3c8-0bbb-4cf9-8181-f3def34f1f4c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.195569 Sep 28 15:43:17.213752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 145/284] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:17 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:18.236071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:18.236704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:18.243713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:18.244189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:18.244955 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:18.245683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:18.246177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:18.246614 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:18.394123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:18.402190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-64498a7a-1f28-4d9b-9e16-3f7b35dc2ade tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.170069 Sep 28 15:43:18.402969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 140/285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:18 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:19.431406 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:19.432628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:19.441329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:19.441817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:19.443496 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:19.444371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:19.444830 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:19.446729 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:19.643150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:19.653197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-40146bf9-7d91-4241-91bf-6a830a97f0ac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1521 microversion: 2.1 time: 0.225516 Sep 28 15:43:19.653967 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 146/286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:19 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:20.678739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:20.679865 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:20.689412 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.692143 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.692891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:20.694711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.697633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.699077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:20.888623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:20.904079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5f1101aa-a37e-4042-9349-ee49bd5b5125 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1501 microversion: 2.1 time: 0.227494 Sep 28 15:43:20.905346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 141/287] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:20 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:20.930234 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:20.931675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:20.937889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.938562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.939189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:20.939892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:20.940659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:20.941383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:21.116382 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:21.144669 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0767f4db-bcdd-487b-81d7-20484f7ee826 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1515 microversion: 2.1 time: 0.202389 Sep 28 15:43:21.167263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 147/288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:20 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:22.766088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:22.768966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:22.789302 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:22.789804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:22.790966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:22.791682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:22.792145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:22.792571 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:22.825033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'flavor' on Instance uuid d9ad4def-5dcf-41f5-be4c-e251a8e878af {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:43:22.984129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-efee6436-89f6-4c53-81c0-73686d7d06e0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/action" status: 200 len: 32 microversion: 2.1 time: 0.222055 Sep 28 15:43:22.985146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 142/289] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:43:22 2022] POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:43:22.999779 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:23.001025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:23.021750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:23.022508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:23.023365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:23.024407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:23.026043 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:23.026660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:23.354647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:23.366093 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bd192e51-2a72-40db-afff-3cf1aec6915c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.375151 Sep 28 15:43:23.366691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 148/290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:22 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:24.394595 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:24.397446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:24.407167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:24.410094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:24.410761 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.411837 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:24.412427 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:24.413002 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.591735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:24.592426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:24.610197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:24.616088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:24.617037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.618282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:24.618910 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:24.619502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:24.646293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:24.650399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-18b0001b-f46b-4916-88c9-fcd6b510e8c1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/ips" status: 200 len: 152 microversion: 2.20 time: 0.063002 Sep 28 15:43:24.658297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 149/291] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Sep 28 15:43:24 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:43:24.662229 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-064759dd-b717-4149-a5d5-c1f690662a27 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.274451 Sep 28 15:43:24.663869 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 143/292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:24 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:25.686060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:25.686659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:25.692643 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.693114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.693545 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.694253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:25.694702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:25.695113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:25.823160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:25.830829 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-eeb63e30-a2bb-4f5a-bf24-18f6fa5ae030 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.148659 Sep 28 15:43:25.831499 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 150/293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:25 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:26.853723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:26.854377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:26.856798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=48 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:26.862111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:26.862583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:26.863010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:26.863687 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:26.864134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:26.864548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:26.990904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:26.999352 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b6878b3d-3bd0-4d90-9972-849354b7a4fc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.149891 Sep 28 15:43:26.999919 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 144/294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:26 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:28.027533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:28.029582 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:28.036993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:28.037640 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:28.039413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:28.040363 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:28.040909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:28.041337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:28.208133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:28.225073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-70193e6d-7b16-4248-8223-385bb5af1e57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.203690 Sep 28 15:43:28.238447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 151/295] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:28 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:29.259265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:29.259957 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:29.267020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.267504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.267942 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.268645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.269097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.269521 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.440157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:29.448940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e9c7035d-c065-408f-b57c-6047fb50a3a6 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.194040 Sep 28 15:43:29.462507 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 145/296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:29 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:29.838185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:29.839484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:29.845941 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.846499 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.846997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.847777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:29.848323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:29.848743 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:29.877129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lazy-loading 'flavor' on Instance uuid 44dffde6-94ba-408b-895a-eaaa80ad0b0f {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:43:29.937979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:30.098339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-816be805-b06f-4dc1-857c-9762392c2e15 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/action" status: 202 len: 0 microversion: 2.20 time: 0.264062 Sep 28 15:43:30.103895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 152/297] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 15:43:29 2022] POST /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:43:30.109362 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:30.110029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:30.122625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.123123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.123814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.124637 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.125091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.125514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.432930 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:30.443079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:30.444869 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:30.446088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e53f31c9-365c-4108-83b3-1b2bd390a1ca tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.341278 Sep 28 15:43:30.446862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 146/298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:30 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:30.474684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:30.475761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:30.483272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.483978 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.484401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.485312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:30.485760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:30.486431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:30.665307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:30.674255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d163879f-6e0b-4532-8b3c-60209ebbfc83 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.203803 Sep 28 15:43:30.695463 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 153/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:30 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:31.473479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.474049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:31.481107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:31.481802 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:31.482424 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:31.483280 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:31.484005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:31.484710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:31.621178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:31.630255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:31.632293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:31.633524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3fb5209a-f851-4a31-b56e-423ad34ff9da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.164224 Sep 28 15:43:31.634606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 147/300] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:31.701679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:31.702473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:31.712177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:31.713319 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:31.714865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:31.717757 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:31.718411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:31.719132 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:31.889074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:31.899756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-75ac144f-b52d-43cf-a42c-5f126d44443c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.202124 Sep 28 15:43:31.900507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 154/301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:31 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:32.047445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.048513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:32.059623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.060363 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.061228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.063044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.063755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.064832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.096460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ec560178-8b14-4793-bd3a-5210123e3829 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/ips" status: 200 len: 146 microversion: 2.1 time: 0.053919 Sep 28 15:43:32.097089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 148/302] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:32.189101 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.189462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:32.197394 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.197915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.198357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.199067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.199520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.199943 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.231446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e8bab781-e761-40cd-ac99-14af0f841d46 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/ips" status: 200 len: 149 microversion: 2.1 time: 0.046160 Sep 28 15:43:32.231446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 155/303] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:43:32.660547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.661148 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:32.668107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.668603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.669024 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.669719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.670260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.670612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.813234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:32.822252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:32.823896 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:32.825122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1b87f302-3291-442b-afec-261fd2946da9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.168460 Sep 28 15:43:32.825747 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 149/304] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:32.922937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:32.923886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:32.930518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.931422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.931945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:32.932889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:32.933553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:32.934200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.092400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:33.108955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a58d5f3a-4a65-46c5-8ff2-eb82655a729d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.190083 Sep 28 15:43:33.109705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 156/305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:32 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:33.673266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d474fdb7-a57f-4694-a3b9-d5080af64a9f"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:33.675801 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:33.682991 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.684831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.685500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.686931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.687594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.688459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.841408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:33.852692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:33.853629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:33.860993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.861469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.861918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.862605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:33.863051 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:33.863741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:33.970693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cfb7561c-78b3-4a76-bde5-a7be4a5eaccb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301511 Sep 28 15:43:33.971573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 150/306] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:43:33 2022] POST /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:34.005759 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:34.015926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:34.017385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:34.018776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-693c7638-7f65-4f5b-860f-c3f5a86c77ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.170993 Sep 28 15:43:34.019613 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 157/307] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:33 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:34.134485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:34.135281 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:34.142202 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.142806 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.143342 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:34.144138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.144786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.145229 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:34.293981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:34.304413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b0a01ac8-443d-48fe-a055-be74da0d6791 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.175442 Sep 28 15:43:34.305422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 151/308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:34 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:34.832912 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7686b4b8-36aa-4121-8aa1-d6b8c81fa1e3"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:34.835414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:34.841406 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.841928 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.842366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:34.843053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:34.843506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:34.843960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:35.044809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:35.045414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:35.052706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:35.053790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:35.054698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:35.055755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:35.056402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:35.057005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:35.149198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5e3f1cf9-a658-47e9-ba26-9ea67677a4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320165 Sep 28 15:43:35.149818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 158/309] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:43:34 2022] POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:35.217966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:35.226530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:35.227942 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:35.229078 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1d57b994-6857-4685-a669-178abae25bc7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.188488 Sep 28 15:43:35.229618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 152/310] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:35 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:35.328583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:35.329269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:35.336508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:35.336988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:35.337420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:35.338165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:35.338611 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:35.339026 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:35.469262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:35.477533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b7205ba6-50f5-4778-bca0-edefef6458d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.153671 Sep 28 15:43:35.478108 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 159/311] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:35 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:36.255692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:36.257507 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:36.264487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.265186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.265611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.266334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.266775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.267188 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.434876 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:36.442955 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:36.445102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:36.446356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a1fdebfa-7b03-41ae-a7a6-43416ece1370 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.195471 Sep 28 15:43:36.447011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 153/312] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:36 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:36.500199 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:36.500802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:36.508170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.508650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.509084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.509774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:36.510291 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:36.510700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:36.639036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:36.646865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-79ed167c-7a63-46be-84ef-263d7f631324 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.150704 Sep 28 15:43:36.647436 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 160/313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:36 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:37.471016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:37.471713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:37.478367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.478846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.479274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.479958 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.480401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.480848 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.611050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:37.619441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:37.621021 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:37.622345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-be9dfc5e-0c4d-4543-bc16-d93303235192 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.155129 Sep 28 15:43:37.622964 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 154/314] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:37 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:37.669618 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:37.670277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:37.676818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.677308 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.677775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.678614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:37.679079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:37.679499 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:37.827417 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:37.835264 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-10f462d6-f4b8-4ceb-94f5-26f39ef06709 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.169413 Sep 28 15:43:37.835833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 161/315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:37 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:38.649142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:38.649687 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:38.656368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.656851 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.657318 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.658053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.658505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.658930 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.860764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:38.861638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:38.872524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.873604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.874034 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:38.876548 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:38.877076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:38.877509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:39.074833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:39.085440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:39.087029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:39.088675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5424c579-0426-4dde-8ca2-8600dd4a4be3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.444149 Sep 28 15:43:39.089368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 155/316] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:38 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:39.121557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:39.129791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a4e04b8c-75fe-4f50-8d23-e40c47509131 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.273013 Sep 28 15:43:39.130390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 162/317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:38 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:40.113025 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:40.113637 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:40.120380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.120862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.121293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.122004 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.122453 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.122978 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.154403 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:40.155623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:40.164069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.164557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.164994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.165695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:40.166336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:40.166764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:40.326173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:40.337323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:40.339673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:40.341076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-aa2d4fcb-b379-44b3-9586-5e0da0115f27 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.231789 Sep 28 15:43:40.353887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 156/318] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:40 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:40.354184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:40.359433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ea6038a7-d2fc-4e56-bff9-3c94b55a5f61 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.209515 Sep 28 15:43:40.360485 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 163/319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:40 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:41.370935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:41.371485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:41.378063 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.378546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.378975 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.379656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.380102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.380517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.383462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:41.384068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:41.390715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.391198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.391632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.392321 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:41.392778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:41.393200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:41.581793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:41.585541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:41.590523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:41.591939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:41.593082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b146edee-ef7c-444d-9b6b-ac5cbffb6cfd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.226783 Sep 28 15:43:41.593613 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 157/320] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:41 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:41.593733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6d71459b-6cd1-4d8a-9f2d-bf9d179e9f06 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.214020 Sep 28 15:43:41.594210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 164/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:41 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:42.616842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:42.617449 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:42.618145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:42.618760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:42.627401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.628495 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.629055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.629716 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.630050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.630841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.631285 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.632531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.633163 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.633773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:42.634275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:42.634708 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:42.835655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:42.843192 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:42.844458 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e2e95b1b-7ded-4f96-8a5e-569bc4bda4cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.232076 Sep 28 15:43:42.845042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 158/322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:42 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:42.849569 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cc69e176-d711-4c45-bb84-8669d6dffa60 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: .version_select at 0x7f11552c7a60>, body: {"keypair": {"name": "tempest-keypair-687395015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT105WH/owql/cPG43Mrm6EPsfGUK9fvquteFG4d9PEBPk5o+XKceDZHkb1eJV4IFvjMJ1uve81byi+crY2jsStPoxd6TsWD0sw75ApiHngAiqqghaj7CG/bZkCkC6N4Q=="}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:42.853685 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:42.855481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:42.857178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f0d06155-7101-4adc-a789-6486610d926f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.242906 Sep 28 15:43:42.857740 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 165/323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:42 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:42.865426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-cc69e176-d711-4c45-bb84-8669d6dffa60 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:43:42.869260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-cc69e176-d711-4c45-bb84-8669d6dffa60 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:43:42.894633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cc69e176-d711-4c45-bb84-8669d6dffa60 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048497 Sep 28 15:43:42.895162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 159/324] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:43:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:43.867295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:43.867915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:43.874561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:43.875039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:43.875466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:43.876700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:43.877157 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:43.877585 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:43.883858 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:43.884754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:43.891072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:43.891870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:43.892475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:43.893371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:43.894094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:43.894672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.185570 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:44.193699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:44.195848 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:44.197221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-207223ff-3869-4953-86c1-34eba134b5b8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.317869 Sep 28 15:43:44.198432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 160/325] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:43 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:44.207876 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:44.216335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a3508405-178a-493b-8257-bd3bebfaecac tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.353007 Sep 28 15:43:44.216895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 166/326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:43 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:44.382415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-386876070", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df05fe18-9205-4e7c-b6d8-ac63aa67e1aa"}], "security_groups": [{"name": "tempest-securitygroup--744213171"}], "key_name": "tempest-keypair-687395015", "user_data": "}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:44.490098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] validate_networks() for [('df05fe18-9205-4e7c-b6d8-ac63aa67e1aa', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:43:44.876573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:43:44.877050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:43:44.877784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:43:44.878315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:43:44.878688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:43:44.888043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:44.888579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:44.888889 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.889657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:44.890149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:44.890544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:44.907230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:43:44.911095 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:43:44.922530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:43:44.924826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:43:44.971651 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bc1c55e9-b79e-411c-b310-c1ead8fa5b54 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594114 Sep 28 15:43:44.978231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 161/327] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:43:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:43:44.984144 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e28d345d-3e48-49ec-ab39-668cf97303b5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:44.984882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e28d345d-3e48-49ec-ab39-668cf97303b5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:45.041183 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e28d345d-3e48-49ec-ab39-668cf97303b5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.048048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e28d345d-3e48-49ec-ab39-668cf97303b5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1240 microversion: 2.1 time: 0.067770 Sep 28 15:43:45.048951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 167/328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:44 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:45.224470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:45.225167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:45.232552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.239623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:45.240318 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:45.242031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.242898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.243849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.244524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.245286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.248910 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.249518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.250076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.250903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:45.251473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:45.251987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:45.540578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.549579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.549720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.551062 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:45.552228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f9c9e242-67dc-44cc-9385-8e05cd4e24cc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.332176 Sep 28 15:43:45.552778 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 162/329] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:45 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:45.555899 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:45.571499 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-69aa2684-db44-4c5e-a01d-f84d13ddc2ef tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.335781 Sep 28 15:43:45.572088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 168/330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:45 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:46.072402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:46.073007 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:46.079351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.079827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.080259 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.080968 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.081422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.081870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.146581 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:46.154813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f50aff53-d8b6-4bb9-bc74-19a967aa478f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1292 microversion: 2.1 time: 0.086221 Sep 28 15:43:46.155371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 163/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:46 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:46.579149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:46.579757 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:46.587340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.587813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.588272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.588959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.589411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.589935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.594583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:46.595187 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:46.600926 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.601400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.601827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.602530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:46.602971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:46.603384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:46.790367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:46.794060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:46.798539 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:46.799983 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:46.801144 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0cb8ff1e-0235-41fc-8b49-21339a6e192c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.226536 Sep 28 15:43:46.801600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-36c54142-5b0e-4db5-b3a3-cdda8005af6f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.210747 Sep 28 15:43:46.801704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 169/332] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:46 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:46.802185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 164/333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:46 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:47.179431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:47.180306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:47.182352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=52 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:47.187494 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.187968 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.188393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.189076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.189521 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.189962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.253012 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:47.260628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-42754e69-ec9c-4c36-a118-4144b4fc1eec tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1292 microversion: 2.1 time: 0.085841 Sep 28 15:43:47.261181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 170/334] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:47 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:47.825328 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:47.825990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:47.826356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:47.826474 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:47.832586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.833012 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.833137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.833487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.833598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.833942 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.834221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.835256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:47.835376 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.835675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:47.835778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:47.836103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.041580 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.045031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.049591 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-420f7586-f666-4a39-905b-a2b8213a7798 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.228173 Sep 28 15:43:48.050681 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 165/335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:47 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:48.056677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.058241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.059425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fb726fbe-5358-4f7d-90de-6bb5581f8205 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.237631 Sep 28 15:43:48.059982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 171/336] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:47 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:48.283599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:48.284123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:48.290141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:48.290616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:48.291046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.291739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:48.292188 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:48.292601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:48.351512 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:48.358873 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9cf66a3a-6155-48b8-a8e3-59214b9b9265 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1292 microversion: 2.1 time: 0.079405 Sep 28 15:43:48.359424 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 166/337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:48 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1292 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:49.076327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:49.076935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:49.083894 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.084884 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.089154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:49.089897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.090003 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:49.090092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.090092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.090092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.094362 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.094847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.095275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.095994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.096441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.096861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.278204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.284924 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.286357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-65d0e5d8-8d2f-48e1-ba81-bd2bf5f67a90 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.216973 Sep 28 15:43:49.287015 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 172/338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:49 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:49.293749 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.295285 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.296441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8062898d-9294-4764-a3f6-6d1bf888f898 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.215896 Sep 28 15:43:49.303559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 167/339] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:49 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:49.383168 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:49.383732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:49.390150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.390642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.391108 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.391808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:49.392286 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:49.392709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:49.451579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:49.459166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b20121cd-bf97-4aff-b33c-d9a77700aa0c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1292 microversion: 2.1 time: 0.080471 Sep 28 15:43:49.460372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 173/340] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:49 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:50.310202 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:50.310815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:50.317273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.317759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.318234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.318956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.319412 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.319836 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.321273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:50.321891 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:50.323986 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:50.328759 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.329290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.329717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.330436 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.330887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.331307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.537832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:50.542224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:50.548369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9c954e31-6443-4142-90b0-3d2ada53a6fb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.241910 Sep 28 15:43:50.549441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 168/341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:50 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:50.554079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:50.554687 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:50.556034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:50.556166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:50.559598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a4f06390-d03b-41fe-868f-4b76aed5540e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.242315 Sep 28 15:43:50.560208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 174/342] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:50 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:50.568411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.568981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.569484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.570295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:50.570844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:50.571335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:50.631000 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:50.638822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-008df5b5-4ddd-41c4-abd2-a38e39d1e36f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1292 microversion: 2.1 time: 0.088188 Sep 28 15:43:50.639579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 169/343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:50 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:51.572205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:51.572813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.579055 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.579537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.580820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.580820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.581188 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.581617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.585552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:51.586712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.593042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.593519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.593973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.595014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.595468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.595885 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.797599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:51.803434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:51.809697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4fc32df4-8218-453e-809d-e63c78754c6e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1501 microversion: 2.1 time: 0.241352 Sep 28 15:43:51.810576 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 175/344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:51 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:51.816977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:51.817801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.825822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:51.827657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:51.829398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.830100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.830759 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.831730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.832344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.833083 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.841559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e6190579-d3fa-4e0b-a3ab-503f82a51a09 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.259601 Sep 28 15:43:51.842706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 170/345] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:51 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:51.848229 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf8fc6df-09fc-42f3-bd7f-26d00ed43e8f"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:51.851826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.863244 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.863832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.864335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.865102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.865622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.866140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.898787 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] HTTP exception thrown: Cannot 'attach_volume' instance d9ad4def-5dcf-41f5-be4c-e251a8e878af while it is in vm_state rescued Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Request method failure captured: Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/os-volume_attachments HTTP/1.1 Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 74 Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs3ZKCm3aPR4SQ3jxI_H_A6V2-5NKmOzV6VGR_hY79N9a9rR6iU_UYFiwx99PuQizzzVQ08loaV8DD6nQ0bQj3UMJHIQiO0SvAZlbdaVXFFzXyRLZE3mHa4XGwobxC5aE0I-lPu2kyxRrXRtrZmyoF8pyUj8_Ss1aHoEA8DC3PtyA4 Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:43:51.900634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_824ddb9f6f344a2684cf31d08427306c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 36515ae6f91748babdcf6a9a72f59ed1 Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {"volumeAttachment": {"volumeId": "cf8fc6df-09fc-42f3-bd7f-26d00ed43e8f"}} Sep 28 15:43:51.902211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Cannot 'attach_volume' instance d9ad4def-5dcf-41f5-be4c-e251a8e878af while it is in vm_state rescued Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'server_id': 'd9ad4def-5dcf-41f5-be4c-e251a8e878af', 'body': {'volumeAttachment': {'volumeId': 'cf8fc6df-09fc-42f3-bd7f-26d00ed43e8f'}}} Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:43:51.903068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d9ad4def-5dcf-41f5-be4c-e251a8e878af while it is in vm_state rescued Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:43:51.905019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d9ad4def-5dcf-41f5-be4c-e251a8e878af while it is in vm_state rescued Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Returning 409 to user: Cannot 'attach_volume' instance d9ad4def-5dcf-41f5-be4c-e251a8e878af while it is in vm_state rescued {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5f30c337-e487-4f38-ad75-65f8435df756 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059188 Sep 28 15:43:51.906817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 171/346] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:43:51 2022] POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 15:43:51.911128 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:51.913010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:51.914073 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:51.920275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-11602aed-6a4a-4a21-a6c6-497f6363ece0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1292 microversion: 2.1 time: 0.108509 Sep 28 15:43:51.921358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 176/347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:51 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:51.921951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.922634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.923065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:51.923761 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:51.924240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:51.925385 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.020028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-286dcffc-94c1-4a6a-8997-0a247bae9c62 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/action" status: 202 len: 0 microversion: 2.1 time: 0.110974 Sep 28 15:43:52.020711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 172/348] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:43:51 2022] POST /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:43:52.034314 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:52.036086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:52.045364 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.045895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.046329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.047038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.047494 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.048006 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.276925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:52.286434 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-624d38f5-dd35-4f05-81bd-014db2ad71cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1509 microversion: 2.1 time: 0.259058 Sep 28 15:43:52.287195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 177/349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:52 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:52.327819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-df86d08a-7b40-467b-a9d7-3270fe0cf9d1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:52.334220 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-df86d08a-7b40-467b-a9d7-3270fe0cf9d1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.334712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-df86d08a-7b40-467b-a9d7-3270fe0cf9d1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.335152 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-df86d08a-7b40-467b-a9d7-3270fe0cf9d1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.396033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-df86d08a-7b40-467b-a9d7-3270fe0cf9d1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Going to try to stop instance {{(pid=127073) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 15:43:52.439830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-df86d08a-7b40-467b-a9d7-3270fe0cf9d1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action" status: 202 len: 0 microversion: 2.1 time: 0.116329 Sep 28 15:43:52.440437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 173/350] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:43:52 2022] POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:43:52.449057 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:52.449670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:52.455842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.456338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.456778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.457487 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.457984 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.458536 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.873378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:52.874848 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:52.884248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.884739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.885985 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:52.886699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:52.887347 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:52.887923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.060893 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.069747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-abe7423f-0c7e-4de2-bab9-c9be8551285a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.624936 Sep 28 15:43:53.070366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 178/351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:52 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:53.085537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:53.085537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:53.085537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:53.085537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:53.086645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.086645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:53.086645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:53.086645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.231033 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.240084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-03ba0454-fb3b-44b3-8577-cf2f403fddc1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1298 microversion: 2.1 time: 0.168710 Sep 28 15:43:53.240655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 179/352] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:53 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:53.254880 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.263323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.264872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.266094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bc7a32d8-e7c3-4576-9b5f-2f14de4010e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.399948 Sep 28 15:43:53.266640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 174/353] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:52 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:53.312366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:53.312980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:53.318914 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:53.319407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:53.319880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.320911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:53.321378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:53.321809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:53.552628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:53.562150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-35a97fd3-fab4-46b7-b189-dcb61e6120f1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1509 microversion: 2.1 time: 0.253762 Sep 28 15:43:53.562947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 180/354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:53 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:54.094289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:54.095761 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:54.102434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.103071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.103616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.104404 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.105051 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.105635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.264020 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:54.265208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:54.278373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.279059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.279668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.280378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.280995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.281417 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.326456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.335255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1e98efcc-bf64-4dbb-8df6-1c86cc9b7691 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.245839 Sep 28 15:43:54.335956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 175/355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:54 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:54.353307 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:54.359652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:54.372409 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.373153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.373598 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.374336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.374790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.375210 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.620700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.629986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-939f6ab4-e3a4-4c1b-a376-3eba12a27e0a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.369553 Sep 28 15:43:54.630598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 181/356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:54 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:54.635958 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:54.637007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:54.643617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.644400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.645116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.646227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.647502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.648587 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.659986 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.676632 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.679888 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.681710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d03550d3-f0d2-4781-abbe-ffec311ba6ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.344370 Sep 28 15:43:54.683079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 176/357] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:54 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:54.881290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:54.889305 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b7ca91f6-55ab-4659-b318-b1c806617444 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1509 microversion: 2.1 time: 0.257162 Sep 28 15:43:54.890195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 182/358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:54 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:54.926196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:54.927284 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=10 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:54.933010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-c5ed9724-16fa-4eee-bea9-2212134abddc req-2a891be8-2273-4854-bd4d-4e0b23e8106b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dc05ad-5958-4041-9643-9646838091a5", "tag": "8a0e2173-599b-42d5-a1a1-8e65b893783f"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:54.954114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c5ed9724-16fa-4eee-bea9-2212134abddc req-2a891be8-2273-4854-bd4d-4e0b23e8106b service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:54.954594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c5ed9724-16fa-4eee-bea9-2212134abddc req-2a891be8-2273-4854-bd4d-4e0b23e8106b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:54.955034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c5ed9724-16fa-4eee-bea9-2212134abddc req-2a891be8-2273-4854-bd4d-4e0b23e8106b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:54.968144 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-c5ed9724-16fa-4eee-bea9-2212134abddc req-2a891be8-2273-4854-bd4d-4e0b23e8106b service nova] Creating event network-changed:8a0e2173-599b-42d5-a1a1-8e65b893783f for instance 67dc05ad-5958-4041-9643-9646838091a5 on hv-cinder-85931 Sep 28 15:43:54.972555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-c5ed9724-16fa-4eee-bea9-2212134abddc req-2a891be8-2273-4854-bd4d-4e0b23e8106b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047082 Sep 28 15:43:54.973531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 177/359] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:55.360734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:55.361810 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:55.364888 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:55.369542 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.370079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.370514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.371262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.371743 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.372162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.508143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:55.517529 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-995d794d-1dd4-4718-bdcb-5388dace164e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.161268 Sep 28 15:43:55.518130 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 183/360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:55 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:55.656215 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:55.657039 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:55.664892 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.665699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.666251 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.666948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.667569 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.668302 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.708543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:55.709219 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:55.715328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.715816 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.716649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.718636 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.719296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.719725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.938303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:55.957714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-43167529-51ad-4d3a-b7c7-b9660de12cfd tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.306325 Sep 28 15:43:55.970040 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 178/361] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:55 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:55.970040 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:55.970040 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:55.970040 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.970504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.970801 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.971538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:55.971993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:55.972418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:55.980665 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:55.989644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:55.991236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:55.992878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1440c7fc-262f-4768-80ab-985b73e3574a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1745 microversion: 2.20 time: 0.288372 Sep 28 15:43:55.993600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 184/362] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:55 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:56.117690 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:56.125494 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0e44316a-807b-439c-8c28-d77ceecb3409 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1509 microversion: 2.1 time: 0.166092 Sep 28 15:43:56.126081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 179/363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:55 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:56.542184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:56.542942 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:56.556569 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:56.557634 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:56.563700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:56.564453 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:56.564914 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:56.565658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:56.593446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:56.807781 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:56.817111 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-34c8ec0f-e260-486b-938c-69f9d710c06f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.280384 Sep 28 15:43:56.817777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 185/364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:56 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:56.981800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:56.982536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:56.985053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:56.990246 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:56.990788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:56.991351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:56.992063 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:56.992526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:56.992966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.019127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:57.019822 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:57.031002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.031304 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.031751 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.032461 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.032918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.033341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.189417 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:57.201582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-816501a6-2b84-4231-9cd0-7d3cc698e422 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.223667 Sep 28 15:43:57.202178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 180/365] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:56 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:57.210407 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:57.211195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:57.217521 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.218252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.218858 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.219714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.220273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.220696 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.221960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:57.231101 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:57.232549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:57.233713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-aee029dd-5575-473b-a51d-b095dad507b7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1745 microversion: 2.20 time: 0.218702 Sep 28 15:43:57.234320 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 186/366] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:57 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:57.352552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:57.360206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0950b9d8-8b6f-49ed-8f13-52935a40ac1c tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1515 microversion: 2.1 time: 0.156936 Sep 28 15:43:57.360760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 181/367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:57 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:57.855472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:57.856092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:57.862582 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.863080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.863514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:57.864262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:57.864724 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:57.865144 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.007439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:58.015639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-27e74c95-0737-46e0-922c-1faa302adf6b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.171928 Sep 28 15:43:58.016391 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 187/368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:57 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:43:58.227165 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:58.228378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:58.235649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:58.236472 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:58.237375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.238594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:58.239152 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:58.239772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.263364 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:58.264492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:58.279903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:58.280502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:58.281054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.281881 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:58.282427 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:58.282946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:58.493670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:58.502138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:58.511393 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ec9283cd-26ad-474b-88a4-8d86b56bbafb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.288948 Sep 28 15:43:58.512025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:58.514275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:58.515563 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-22fd14cd-3b91-421b-b166-cded0f7b2888 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1745 microversion: 2.20 time: 0.258957 Sep 28 15:43:58.516106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 188/369] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:58 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1745 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:43:58.529826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 182/370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:58 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:58.727853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3fbb5452-d499-4931-ad12-c0c92156b124 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'create', calling method: .version_select at 0x7f1156769430>, body: {"keypair": {"name": "tempest-keypair-1717174622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr50k+eGBTcxoCKX+Ipwk6qYredSY/Ps3KmI9fBsEnPqy0x5LdtlDej14YwINllsZyxO0yXoapIbh83W8qYGLJ7mxb9eJxUBhC8EBHUbuxmFUQW2IaAzASf+9RuEG66tg=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:43:58.744945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-3fbb5452-d499-4931-ad12-c0c92156b124 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for project 824ddb9f6f344a2684cf31d08427306c. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:43:58.749239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-3fbb5452-d499-4931-ad12-c0c92156b124 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for user 36515ae6f91748babdcf6a9a72f59ed1 and project 824ddb9f6f344a2684cf31d08427306c. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:43:58.778297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3fbb5452-d499-4931-ad12-c0c92156b124 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055202 Sep 28 15:43:58.778881 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 189/371] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:43:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:43:59.040893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:59.041932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:59.048750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.049227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.049652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.050525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.051143 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.051567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.207442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:59.211571 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:43:59.216688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e0ab91dc-7a7d-48a1-ba86-3dc217292acf tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.181505 Sep 28 15:43:59.217453 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 183/372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:59 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:43:59.540068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:59.540874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:59.541612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:43:59.542754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:43:59.547960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.548519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.549173 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.550124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.550636 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.551121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.551292 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.551555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.552031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.552248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:43:59.552866 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:43:59.553448 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:43:59.752963 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:59.763469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:59.765196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:59.766822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cba9ac49-4a46-44e5-9a7f-d46b45d038af tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1745 microversion: 2.20 time: 0.229452 Sep 28 15:43:59.767355 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 184/373] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:43:59 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:43:59.803938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:43:59.813201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f1857381-4ab5-4be7-a8c9-16a9f935711e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.281441 Sep 28 15:43:59.813811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 190/374] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:43:59 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:00.240631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:00.241792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:00.248523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:00.249230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:00.249670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:00.250401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:00.251044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:00.251474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:00.421185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:00.432260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a49ce0af-bb94-4184-913b-35c241a83493 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.195342 Sep 28 15:44:00.444199 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 185/375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:00 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:00.525510 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-288695525", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b037e357-8df3-4ca3-8b1b-f30273c72384"}], "security_groups": [{"name": "tempest-securitygroup--1547562376"}], "key_name": "tempest-keypair-1717174622", "user_data": "}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:00.635927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] validate_networks() for [('b037e357-8df3-4ca3-8b1b-f30273c72384', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:44:00.793164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:00.793979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:00.802383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:00.802973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:00.803473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:00.805384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:00.805949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:00.806441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.157655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:01.167748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:01.169275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:01.170692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0f06c446-cb20-4313-9714-83b09299debc tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1745 microversion: 2.20 time: 0.381497 Sep 28 15:44:01.177139 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 186/376] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:00 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1745 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:01.180727 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:01.181436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:01.187996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.188628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.189162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.189997 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.190534 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.190965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.411116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:01.416206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:44:01.416929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:44:01.417509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:44:01.418592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:44:01.419473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:44:01.419753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b6d2af46-7d80-4ae6-b501-c113692d16a9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.247025 Sep 28 15:44:01.420389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 187/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:01 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:01.430540 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.431371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.431976 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.432919 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.445484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.446218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.461807 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:01.463395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:01.476038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.481354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for project 824ddb9f6f344a2684cf31d08427306c. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:44:01.482602 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.483066 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.483830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:01.484298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:01.484730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:01.487369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Getting quotas for user 36515ae6f91748babdcf6a9a72f59ed1 and project 824ddb9f6f344a2684cf31d08427306c. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:44:01.502041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:44:01.505622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:44:01.572608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d898f0c6-a3cc-4954-a0fe-f3f8bef557be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.050879 Sep 28 15:44:01.573992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 191/378] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:44:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:44:01.585801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f262bcf6-efb9-4787-a43a-04d4e818805f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:01.590678 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f262bcf6-efb9-4787-a43a-04d4e818805f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:01.673500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f262bcf6-efb9-4787-a43a-04d4e818805f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:01.684149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f262bcf6-efb9-4787-a43a-04d4e818805f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1245 microversion: 2.1 time: 0.103059 Sep 28 15:44:01.685345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 192/379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:01 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:01.731097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:01.739398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-dd42f91d-3e3f-471f-9a10-9af8da4d6efd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.283177 Sep 28 15:44:01.740465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 188/380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:01 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:02.199213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:02.200041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:02.206703 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.207192 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.207620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.208529 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.208987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.209413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.353533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:02.365100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:02.367483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:02.368816 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0a75499d-d4ac-452e-b093-903a81166944 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.175512 Sep 28 15:44:02.369447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 193/381] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:02 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:02.443419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:02.444032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:02.451177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.451667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.452124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.453617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.454114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.454538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.658401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:02.669544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-637f503f-e37a-46df-aebb-f91cd14d013a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.229883 Sep 28 15:44:02.670888 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 189/382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:02 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:02.707483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:02.708087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:02.720300 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.721249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.722010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.723259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.724067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.724721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.765659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:02.766513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:02.773293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.774155 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.774900 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.775798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:02.776528 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:02.777163 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:02.823000 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:02.842443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b8750c3d-f692-49a9-875a-973120e65e73 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1297 microversion: 2.1 time: 0.138665 Sep 28 15:44:02.843448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 194/383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:02 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1297 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:03.015636 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.024945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5f99793e-305a-4dfb-a260-2dd555adf172 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.263234 Sep 28 15:44:03.038461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 190/384] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:02 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:03.161433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-d29d6366-2617-4a7e-b411-2c176af5d652 req-ddb163bd-d311-495f-9693-5a4ee3ab9150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dc05ad-5958-4041-9643-9646838091a5", "name": "network-vif-plugged", "status": "completed", "tag": "8a0e2173-599b-42d5-a1a1-8e65b893783f"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:03.177411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d29d6366-2617-4a7e-b411-2c176af5d652 req-ddb163bd-d311-495f-9693-5a4ee3ab9150 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.181480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d29d6366-2617-4a7e-b411-2c176af5d652 req-ddb163bd-d311-495f-9693-5a4ee3ab9150 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.182251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-d29d6366-2617-4a7e-b411-2c176af5d652 req-ddb163bd-d311-495f-9693-5a4ee3ab9150 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.201237 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-d29d6366-2617-4a7e-b411-2c176af5d652 req-ddb163bd-d311-495f-9693-5a4ee3ab9150 service nova] Creating event network-vif-plugged:8a0e2173-599b-42d5-a1a1-8e65b893783f for instance 67dc05ad-5958-4041-9643-9646838091a5 on hv-cinder-85931 Sep 28 15:44:03.208793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-d29d6366-2617-4a7e-b411-2c176af5d652 req-ddb163bd-d311-495f-9693-5a4ee3ab9150 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052427 Sep 28 15:44:03.210505 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 195/385] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:03.395207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:03.395822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:03.408353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.408858 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.409299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.410072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.410532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.414119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.578292 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.587779 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.589212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.590428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-60996772-67f7-49bc-901b-07de99b46025 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.199111 Sep 28 15:44:03.591242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 191/386] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:03 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:03.693208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:03.694328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:03.701583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.702548 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.703005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.704056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.704730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.705352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.867459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:03.868083 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:03.876251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.885578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.885748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f9e8c851-3fd7-41ed-a5ff-98969688a446 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.196668 Sep 28 15:44:03.886678 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 196/387] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:03 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:03.903540 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.904579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.905587 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:03.906213 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:03.906750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:03.974445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:03.982362 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-87f82bb2-b3f4-4502-814f-315101238580 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1303 microversion: 2.1 time: 0.119046 Sep 28 15:44:03.982920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 192/388] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:03 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:04.049637 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:04.050414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:04.057620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.059056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.059996 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.061150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.061958 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.062566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.222901 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:04.231686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-393de2c5-ea68-4bc8-b17d-baa4176c8c7d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.185873 Sep 28 15:44:04.232266 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 197/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:04 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:04.616646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:04.617383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:04.625248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.625817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.626518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.627590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.628216 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.628741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.769550 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:04.777839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:04.779299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:04.780690 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-aa4d890a-a1cb-4e56-8e2b-7a9da6b4b25c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.168253 Sep 28 15:44:04.789809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 193/390] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:04 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:04.909946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:04.911462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:04.918851 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.921208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.924351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:04.925384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:04.926037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:04.926627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.006777 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:05.007478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:05.014649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.015243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.015666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.016372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.016822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.017310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.090504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:05.103744 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f385e142-bdc7-4176-8f3f-1aad26cfe451 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1303 microversion: 2.1 time: 0.100839 Sep 28 15:44:05.108242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 194/391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:05 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:05.127513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:05.136050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c63e29a4-312e-4395-b09d-7f8dfbf66403 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.230186 Sep 28 15:44:05.136842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 198/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:04 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:05.230354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-4649ce82-6fdb-4bfb-b30f-ef5bd3456893 req-56539f6f-5f24-4122-af17-3321f4ab4c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "name": "network-vif-plugged", "status": "completed", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:05.240708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-4649ce82-6fdb-4bfb-b30f-ef5bd3456893 req-56539f6f-5f24-4122-af17-3321f4ab4c10 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.241335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-4649ce82-6fdb-4bfb-b30f-ef5bd3456893 req-56539f6f-5f24-4122-af17-3321f4ab4c10 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.241890 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-4649ce82-6fdb-4bfb-b30f-ef5bd3456893 req-56539f6f-5f24-4122-af17-3321f4ab4c10 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.255043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-4649ce82-6fdb-4bfb-b30f-ef5bd3456893 req-56539f6f-5f24-4122-af17-3321f4ab4c10 service nova] Creating event network-vif-plugged:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:44:05.256344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:05.258104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:05.260883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-4649ce82-6fdb-4bfb-b30f-ef5bd3456893 req-56539f6f-5f24-4122-af17-3321f4ab4c10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035711 Sep 28 15:44:05.261723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 195/393] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:05.268513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.268968 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.269573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.270479 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.271090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.271669 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.426199 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:05.435889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-992f8001-29dc-4d3c-a205-658b8642e50b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.183679 Sep 28 15:44:05.436493 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 199/394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:05 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:05.808599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:05.810208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:05.817172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.817939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.819573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:05.820470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:05.821133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:05.821765 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.067198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.075931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.083477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.085443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-777bcd34-3799-4daf-96b3-7e82d0b26704 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.281169 Sep 28 15:44:06.098939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 196/395] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:05 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:06.128774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:06.130556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:06.142369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.143138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.143745 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.145283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.146413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.147069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.161373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:06.162331 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:06.170214 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.171003 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.171799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.172727 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.173430 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.174088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.296998 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.322896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bbed7e2b-858e-46a8-9edf-8c931c6b1a59 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1303 microversion: 2.1 time: 0.198111 Sep 28 15:44:06.340931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 200/396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:06 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1303 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:06.461051 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:06.461987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:06.466012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.477205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-792491e5-88f1-44e5-bd6d-d58f782c16d2 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.320603 Sep 28 15:44:06.481577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.482485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 197/397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:06 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:06.482920 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.483521 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.484413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:06.485014 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:06.485585 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:06.735087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:06.744773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a2fd5244-0d63-4dce-b287-196d5cc604e8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.289070 Sep 28 15:44:06.745374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 201/398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:06 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:07.111050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:07.111817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:07.123644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.124136 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.125119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.130644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.131956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.132609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.354828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:07.356201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:07.363269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.363845 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.364523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.365306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.365901 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.366435 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.391258 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:07.400459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:07.402359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:07.403706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c241e118-d7b0-4ad0-b4b7-5d230a002123 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.297119 Sep 28 15:44:07.404451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 198/399] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:07 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:07.509121 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:07.509889 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:07.523401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.525337 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.526035 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.526969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.527707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.528321 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.716079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:07.727413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9ed9b39c-c478-496f-a984-c5758e1aad8d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.376662 Sep 28 15:44:07.746019 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 202/400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:07 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:07.776379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:07.778276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:07.785000 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.785485 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.786246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.787100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:07.788523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:07.789092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:07.824194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:07.832029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d5abce24-ff8b-46db-b0ac-7c6face7446a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.327263 Sep 28 15:44:07.851106 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 199/401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:07 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:08.076778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:08.086603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bf387be2-dd0d-4a2c-9c87-98ed5d7f8c52 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.315412 Sep 28 15:44:08.087719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 203/402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:07 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:08.313413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-53fb0f42-a017-41d7-8079-ce8b4650a650 req-377121ea-2c71-4388-b8a8-2635bea04794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf736d9-c255-4f14-8763-4d61838297a8", "tag": "df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:08.332784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-53fb0f42-a017-41d7-8079-ce8b4650a650 req-377121ea-2c71-4388-b8a8-2635bea04794 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.333258 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-53fb0f42-a017-41d7-8079-ce8b4650a650 req-377121ea-2c71-4388-b8a8-2635bea04794 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.333801 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-53fb0f42-a017-41d7-8079-ce8b4650a650 req-377121ea-2c71-4388-b8a8-2635bea04794 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.357223 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-53fb0f42-a017-41d7-8079-ce8b4650a650 req-377121ea-2c71-4388-b8a8-2635bea04794 service nova] Creating event network-changed:df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b for instance cbf736d9-c255-4f14-8763-4d61838297a8 on hv-cinder-85931 Sep 28 15:44:08.363333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-53fb0f42-a017-41d7-8079-ce8b4650a650 req-377121ea-2c71-4388-b8a8-2635bea04794 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053939 Sep 28 15:44:08.364220 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 200/403] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:08.429994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:08.431303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:08.441659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.442936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.443535 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.444523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.445350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.445975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.601925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:08.610714 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:08.612492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:08.613694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9045a685-90a7-44e8-bd97-32c50beeeaf7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.189037 Sep 28 15:44:08.614293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 204/404] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:08 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:08.754949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:08.755655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:08.762601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.763089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.763524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.764221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.764676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.765102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.857272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:08.858037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:08.864299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.864891 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.865389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.866752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:08.867203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:08.867644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:08.897817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:08.932688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:08.936668 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:08.947958 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7a6bf233-c8e6-42b8-be8c-2753f8fb23be tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.197242 Sep 28 15:44:08.949140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 201/405] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:08 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:09.046683 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:09.055608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f42beeb0-eb81-46db-ae73-59cd71ad78f1 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.202301 Sep 28 15:44:09.056750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 205/406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:08 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:09.112571 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:09.115406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:09.120400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.121082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.121512 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.122231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.122961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.123671 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.264281 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:09.273608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-57d034ee-5731-4424-a95a-f39203742ebe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.165186 Sep 28 15:44:09.274425 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 202/407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:09 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:09.640850 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:09.641404 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:09.647892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:09.649288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.649770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.650230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.650995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.651682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.652266 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.798096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:09.807216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:09.808751 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:09.810317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3c21ee46-7e03-49e7-a4fa-c59a37b66806 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.173506 Sep 28 15:44:09.811070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 206/408] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:09 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:09.974804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:09.977583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:09.984721 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.985218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.985655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:09.986399 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:09.986887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:09.987335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.079378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:10.079999 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:10.092852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.093453 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.094659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.095390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.095858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.096393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.158964 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:10.167054 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-06edc171-fa41-44aa-823c-8a3d600646b5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.196173 Sep 28 15:44:10.168017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 203/409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:09 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:10.258381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:10.269171 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-32cc9cfd-fe1a-4f7e-9cc4-ddfa370bcccc tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1365 microversion: 2.1 time: 0.193484 Sep 28 15:44:10.269748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 207/410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:10 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:10.301207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:10.301793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:10.308224 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.308730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.309180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.309921 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.310404 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.310828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.459145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:10.470626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b99c2c46-5393-43d8-ba44-fee009391458 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.177409 Sep 28 15:44:10.471231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 204/411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:10 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:10.840924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:10.842160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:10.859418 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.860178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.860773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:10.861702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:10.862343 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:10.862933 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.167904 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.180979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.183014 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.186846 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0d9e243f-0c52-42b7-ad2f-85980b2867c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.349921 Sep 28 15:44:11.203256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.203256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.203256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.203256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.204135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.204135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.204135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.204135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.209308 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 208/412] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:10 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:11.301651 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.303470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.310146 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.310878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.311514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.312814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.313519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.313989 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.470375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.472088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:11.479525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b3e3b458-7254-4b0f-8368-ffe37b37cc5b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.292950 Sep 28 15:44:11.484255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 205/413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:11 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:11.498847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.510634 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.517618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.518488 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.519136 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.520074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.520734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.522712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.642672 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.654267 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-58a4b285-cf3d-4fa3-aa48-f198636a0106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1555 microversion: 2.1 time: 0.356400 Sep 28 15:44:11.656942 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 209/414] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:11 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:11.681311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:11.681816 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:11.687478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=12 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:11.689392 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.689956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.690560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.691824 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:11.692351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:11.692774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:11.877648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d7425ff2-61a3-4256-9d3b-88c7cd0197cf tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191925 Sep 28 15:44:11.877648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 210/415] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:44:11 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:44:11.953963 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:11.970663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ae33e0f4-07b5-414f-a115-952653087812 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.475678 Sep 28 15:44:11.971813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 206/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:11 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:12.221441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:12.223365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:12.239723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.240571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.243131 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.244083 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.244750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.245322 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.507181 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:12.508522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:12.515667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.516676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.517328 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.518288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:12.518953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:12.519615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:12.812460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:12.824407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:12.832137 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:12.833399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1d1e54d1-002a-41bd-b417-fbc7947b90a4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.620750 Sep 28 15:44:12.837931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 211/417] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:12 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:12.867904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:12.877046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0fc55221-8c3c-4cf1-accd-737d82d71c5d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.373692 Sep 28 15:44:12.902054 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 207/418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:12 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:12.997109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:12.998009 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:13.014986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.015501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.015946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.016672 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.017134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.017562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.223445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:13.247389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2c7c5db0-78d5-4dbc-98c4-929d29a80214 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1723 microversion: 2.1 time: 0.253364 Sep 28 15:44:13.249956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 212/419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:12 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:13.364831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-9a2bce17-1e26-4056-82e2-ab0a3c2f5a54 req-1c21f199-fd57-4868-87cb-fe6d127ba8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67dc05ad-5958-4041-9643-9646838091a5", "tag": "8a0e2173-599b-42d5-a1a1-8e65b893783f"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:13.385265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-9a2bce17-1e26-4056-82e2-ab0a3c2f5a54 req-1c21f199-fd57-4868-87cb-fe6d127ba8e4 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.385753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-9a2bce17-1e26-4056-82e2-ab0a3c2f5a54 req-1c21f199-fd57-4868-87cb-fe6d127ba8e4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.386217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-9a2bce17-1e26-4056-82e2-ab0a3c2f5a54 req-1c21f199-fd57-4868-87cb-fe6d127ba8e4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.411211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-9a2bce17-1e26-4056-82e2-ab0a3c2f5a54 req-1c21f199-fd57-4868-87cb-fe6d127ba8e4 service nova] Creating event network-changed:8a0e2173-599b-42d5-a1a1-8e65b893783f for instance 67dc05ad-5958-4041-9643-9646838091a5 on hv-cinder-85931 Sep 28 15:44:13.421217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-9a2bce17-1e26-4056-82e2-ab0a3c2f5a54 req-1c21f199-fd57-4868-87cb-fe6d127ba8e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060024 Sep 28 15:44:13.421873 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 208/420] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:13.857739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:13.858381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:13.864561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.865049 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.866008 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.866708 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.867159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.867581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.904987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:13.905690 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:13.916019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.916511 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.916947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:13.917648 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:13.926286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:13.926938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.312857 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:14.327606 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:14.329325 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:14.329681 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:14.332817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f122845e-0990-451e-9783-f8445095cffe tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1740 microversion: 2.20 time: 0.478536 Sep 28 15:44:14.333616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 213/421] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:13 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1740 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:14.342348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:14.343116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:14.353395 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.354160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.355172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.356065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.357384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.358001 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.371931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6babf0f4-5131-4add-911c-6f00c5f57663 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.471014 Sep 28 15:44:14.396218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 209/422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:13 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:14.664216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:14.673872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2fe27fb6-dfe3-4b6d-ad2d-a4cd57d4dfc4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1700 microversion: 2.1 time: 0.337632 Sep 28 15:44:14.674374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 214/423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:14 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1700 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:14.704324 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fd7a5f9d-a558-464a-8929-dceb7c9be7ad tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:14.711592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd7a5f9d-a558-464a-8929-dceb7c9be7ad tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.712231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd7a5f9d-a558-464a-8929-dceb7c9be7ad tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.712760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd7a5f9d-a558-464a-8929-dceb7c9be7ad tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.737793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fd7a5f9d-a558-464a-8929-dceb7c9be7ad tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Going to try to start instance {{(pid=127073) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 15:44:14.795707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fd7a5f9d-a558-464a-8929-dceb7c9be7ad tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action" status: 202 len: 0 microversion: 2.1 time: 0.095476 Sep 28 15:44:14.798029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 210/424] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:44:14 2022] POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:44:14.805311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:14.806449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:14.817871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.819177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.819862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:14.821023 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:14.821713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:14.822403 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.136203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.144692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-aaa27b80-00be-4f06-88e6-6e4723e587f3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1709 microversion: 2.1 time: 0.343560 Sep 28 15:44:15.145277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 215/425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:14 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1709 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:15.363053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:15.363741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:15.370304 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:15.370781 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:15.371209 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.371893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:15.372591 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:15.373011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.399695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:15.400300 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:15.406295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:15.406776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:15.407206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.407897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:15.408351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:15.408834 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:15.559006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.567091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.568524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.569673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3372e2aa-5a2f-4a21-a513-16cebd667724 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1722 microversion: 2.20 time: 0.211544 Sep 28 15:44:15.570251 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 211/426] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:15 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:15.580037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:15.587635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c69f4df3-7a7f-4d61-8c38-7a0ca1a15107 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.191802 Sep 28 15:44:15.588184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 216/427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:15 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:16.169451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:16.170107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:16.177962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.178452 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.178886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.180069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.180824 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.181385 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.316482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.325270 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-993a1825-df82-439d-95e9-c11328a8997f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1709 microversion: 2.1 time: 0.159743 Sep 28 15:44:16.325828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 212/428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:16 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:16.594967 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:16.595564 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:16.602054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.602542 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.603061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.603793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.604255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.604762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.609651 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:16.610270 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:16.616536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.617006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.617432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.618138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:16.618590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:16.619089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:16.919717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.922791 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.928456 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.929926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:16.930670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bfbb0f95-f6a5-4e36-b449-fe32a6ff7689 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.324790 Sep 28 15:44:16.931122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-04289e0d-e138-4ac4-8d32-8d9b6021138f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1722 microversion: 2.20 time: 0.340171 Sep 28 15:44:16.931353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 213/429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:16 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:16.931671 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 217/430] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:16 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:17.348735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:17.349874 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:17.355938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.356421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.356875 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.357561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.358127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.358553 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.493310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:17.501688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c7969910-89b9-441d-bcf5-4bc31b5fa1ae tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1709 microversion: 2.1 time: 0.157038 Sep 28 15:44:17.502276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 214/431] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:17 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:17.907599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-4432d5ea-e322-4c6f-889d-3175fed93262 req-c7a5346a-0912-41cb-8014-60392127ec4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "name": "network-vif-unplugged", "status": "completed", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:17.919941 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-4432d5ea-e322-4c6f-889d-3175fed93262 req-c7a5346a-0912-41cb-8014-60392127ec4d service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.920504 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-4432d5ea-e322-4c6f-889d-3175fed93262 req-c7a5346a-0912-41cb-8014-60392127ec4d service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.921005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-4432d5ea-e322-4c6f-889d-3175fed93262 req-c7a5346a-0912-41cb-8014-60392127ec4d service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.932564 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-4432d5ea-e322-4c6f-889d-3175fed93262 req-c7a5346a-0912-41cb-8014-60392127ec4d service nova] Creating event network-vif-unplugged:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:44:17.937689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-4432d5ea-e322-4c6f-889d-3175fed93262 req-c7a5346a-0912-41cb-8014-60392127ec4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048203 Sep 28 15:44:17.938441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 218/432] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:17.960545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:17.961192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:17.973272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:17.974004 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:17.977451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.977971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.978407 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.980613 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.981086 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.981516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.990444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.990937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.991374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:17.992080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:17.992534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:17.992973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:18.215371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:18.218395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:18.224513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:18.226195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:18.226755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e9751a3a-c001-4019-9e71-c55afd338bce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.277308 Sep 28 15:44:18.227320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 215/433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:17 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:18.228090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7a5e504a-0607-4c30-8b65-9614705a7edb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1722 microversion: 2.20 time: 0.262458 Sep 28 15:44:18.228727 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 219/434] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:17 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:18.524515 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:18.525117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:18.531134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:18.531616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:18.532051 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:18.532755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:18.533208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:18.533629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:18.662402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:18.670554 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-caf21c3c-526f-47e2-a987-6bf77b1f957f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1709 microversion: 2.1 time: 0.149889 Sep 28 15:44:18.671133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 216/435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:18 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:19.251444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:19.252080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:19.256020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:19.256631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:19.258727 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.259212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.259646 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.260341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.260790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.261220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.263117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.263605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.264044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.264737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.265194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.265649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.483710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:19.489449 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:19.498162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:19.498328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a4ee375b-68bf-4a72-8188-55ac5296490b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.250827 Sep 28 15:44:19.498746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 220/436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:19 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:19.499665 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:19.500936 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a4e3fb05-c000-4a95-8789-5d7b8300b06a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1722 microversion: 2.20 time: 0.248758 Sep 28 15:44:19.501472 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 217/437] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:19 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:19.694562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:19.695174 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:19.703196 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.703990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.704461 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.706165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.706628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.707103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.847239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:19.856784 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5c926076-ecbf-4ace-8eb4-b50b56e3df15 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1709 microversion: 2.1 time: 0.166687 Sep 28 15:44:19.857367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 221/438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:19 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:19.954692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-826d9b59-05b8-4eac-990d-74409a5925a1 req-f3afeca1-5eca-480d-a84a-b51888dfb986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf736d9-c255-4f14-8763-4d61838297a8", "name": "network-vif-plugged", "status": "completed", "tag": "df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:19.964304 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-826d9b59-05b8-4eac-990d-74409a5925a1 req-f3afeca1-5eca-480d-a84a-b51888dfb986 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:19.964779 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-826d9b59-05b8-4eac-990d-74409a5925a1 req-f3afeca1-5eca-480d-a84a-b51888dfb986 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:19.965205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-826d9b59-05b8-4eac-990d-74409a5925a1 req-f3afeca1-5eca-480d-a84a-b51888dfb986 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:19.969036 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:19.978480 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-826d9b59-05b8-4eac-990d-74409a5925a1 req-f3afeca1-5eca-480d-a84a-b51888dfb986 service nova] Creating event network-vif-plugged:df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b for instance cbf736d9-c255-4f14-8763-4d61838297a8 on hv-cinder-85931 Sep 28 15:44:19.983499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-826d9b59-05b8-4eac-990d-74409a5925a1 req-f3afeca1-5eca-480d-a84a-b51888dfb986 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032536 Sep 28 15:44:19.984082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 218/439] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:20.520554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:20.521301 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:20.527684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:20.528210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.528352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.528455 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:20.528771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.529465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.529940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.530367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.534828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.535318 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.535741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.536422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.537030 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.537449 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.776661 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:20.781641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:20.785497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-58a89211-b076-454f-bcd7-af12e7b62867 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.268792 Sep 28 15:44:20.786303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 222/440] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:20 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:20.791227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:20.793169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:20.802607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-26690f6b-769a-434c-8b9e-33065c6bf6d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1725 microversion: 2.20 time: 0.272242 Sep 28 15:44:20.802607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 219/441] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:20 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:20.820173 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26060b00-00c9-498e-8879-6b6002a0d248"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:20.823053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:20.829484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.830078 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.830608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.831549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.832105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.832602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.837555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:20.880316 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:20.880952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:20.887411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.887886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.888320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:20.889004 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:20.889450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:20.889884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.026402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:21.034556 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e8d029c1-4865-4066-b2aa-8957688cad59 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1713 microversion: 2.1 time: 0.158031 Sep 28 15:44:21.035111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 220/442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:20 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:21.128079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f2976f1e-58bf-4e1b-a0af-fe552d4232b1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.312479 Sep 28 15:44:21.128715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 223/443] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Sep 28 15:44:20 2022] POST /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:44:21.277130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:21.277656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:21.283536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.284062 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.284496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.285184 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.285633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.286087 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.328756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127073) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 15:44:21.397156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2b9c1ae0-cef5-45c9-bc01-b461a9dd2d4b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/action" status: 202 len: 0 microversion: 2.20 time: 0.124084 Sep 28 15:44:21.397993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 221/444] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 15:44:21 2022] POST /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:44:21.407232 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:21.407923 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:21.417570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.418178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.418741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.419570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.420119 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.420612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.591820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:21.601259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:21.602960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:21.604222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-36c629f2-229f-47d5-81db-5ab4778fe4ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1751 microversion: 2.20 time: 0.201772 Sep 28 15:44:21.604854 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 224/445] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:21 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:21.811359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:21.812108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:21.819261 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.821119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.821556 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:21.822282 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:21.822737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:21.823357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:22.015133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:22.023498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-607e29b7-4fb2-4892-90a5-3bd9220b9a70 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1371 microversion: 2.1 time: 0.217951 Sep 28 15:44:22.024519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 222/446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:21 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:44:22.629727 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:22.630356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:22.637430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:22.637827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:22.638284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:22.638975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:22.639446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:22.640032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:22.793054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:22.802261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:22.804573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:22.805793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9e4bf9ab-dfbc-4650-af11-653c20e36063 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1753 microversion: 2.20 time: 0.179884 Sep 28 15:44:22.806400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 225/447] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:22 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:23.047483 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:23.048086 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:23.055006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:23.055483 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:23.055916 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:23.056606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:23.057059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:23.057594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:23.192614 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:23.201312 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e07f4dcc-71bd-402e-9f73-809efd20fbe3 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1565 microversion: 2.1 time: 0.157566 Sep 28 15:44:23.202108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 223/448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:44:23 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:44:23.226818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:23.227316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:23.233793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:23.234409 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:23.234850 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:23.235848 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:23.236289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:23.236849 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:23.343248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9feb4efc-e019-4146-a90a-2af417ae6d29 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122550 Sep 28 15:44:23.343857 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 226/449] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:44:23 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:23.834884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:23.837026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:23.855633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:23.857392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:23.858157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:23.859205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:23.859906 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:23.861392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:24.157960 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:24.173415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:24.175406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:24.176290 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c01f074b-c371-4d72-8489-7a6512474a80 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1753 microversion: 2.20 time: 0.348039 Sep 28 15:44:24.176839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 224/450] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:23 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1753 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:24.823467 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-862735b3-7dc3-4ceb-8662-901ec3749940 req-c76975a2-5409-455d-bb86-d1e66de7abfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf736d9-c255-4f14-8763-4d61838297a8", "tag": "df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:24.834731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-862735b3-7dc3-4ceb-8662-901ec3749940 req-c76975a2-5409-455d-bb86-d1e66de7abfb service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:24.835221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-862735b3-7dc3-4ceb-8662-901ec3749940 req-c76975a2-5409-455d-bb86-d1e66de7abfb service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:24.835719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-862735b3-7dc3-4ceb-8662-901ec3749940 req-c76975a2-5409-455d-bb86-d1e66de7abfb service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:24.848297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-862735b3-7dc3-4ceb-8662-901ec3749940 req-c76975a2-5409-455d-bb86-d1e66de7abfb service nova] Creating event network-changed:df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b for instance cbf736d9-c255-4f14-8763-4d61838297a8 on hv-cinder-85931 Sep 28 15:44:24.854537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-862735b3-7dc3-4ceb-8662-901ec3749940 req-c76975a2-5409-455d-bb86-d1e66de7abfb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035733 Sep 28 15:44:24.855140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 227/451] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:25.204656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:25.205256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:25.212104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:25.212578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:25.213003 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:25.213686 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:25.214189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:25.214635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:25.345536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:25.354196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:25.355567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:25.356723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d2d53c67-9d07-4425-9a49-07a14e3c50d9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1753 microversion: 2.20 time: 0.156017 Sep 28 15:44:25.357274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 225/452] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:25 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:26.382003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:26.382696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:26.389385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:26.389884 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:26.390320 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:26.391009 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:26.391503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:26.391919 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:26.528766 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:26.538058 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:26.539495 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:26.540633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6efb68f7-c7c9-4450-b534-98e4c2b32965 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1753 microversion: 2.20 time: 0.162985 Sep 28 15:44:26.541188 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 228/453] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:26 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:27.565609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:27.566262 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:27.570875 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:27.576956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:27.577442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:27.577886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:27.578711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:27.579182 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:27.579596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:27.844574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:27.855120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:27.856883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:27.857843 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7854943e-c1d6-48e8-b797-488c557643ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.296510 Sep 28 15:44:27.858849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 226/454] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:27 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:28.885303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:28.886007 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:28.895656 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:28.901122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:28.901771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:28.902854 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:28.903502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:28.904522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:29.088783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:29.099308 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:29.101125 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:29.102973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-46f626d9-6973-4c79-95d2-cef22ad84a36 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.223228 Sep 28 15:44:29.103522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 229/455] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:28 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:30.130175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:30.131273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:30.139716 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:30.140564 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:30.141607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:30.142457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:30.142981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:30.143473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:30.334987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:30.343868 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:30.345318 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:30.346513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b2f57c4d-810e-4575-863e-9fb66d94bf65 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.221694 Sep 28 15:44:30.347056 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 227/456] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:30 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:44:31.371343 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:31.372199 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:31.378868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:31.379381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:31.379813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:31.381106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:31.381579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:31.382096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:31.529090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:31.538667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:31.540088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:31.541320 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1e6beacc-c8b2-4b9a-aff1-36c0ae220e6b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.173936 Sep 28 15:44:31.541892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 230/457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:31 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:32.566932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:32.567699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:32.574599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:32.575149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:32.575678 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:32.576473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:32.577020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:32.577539 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:32.728035 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:32.737794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:32.739240 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:32.740433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2b8b211d-519c-40a2-a325-6a573896e59f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.177515 Sep 28 15:44:32.741299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 228/458] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:32 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:33.768730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:33.769352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:33.776588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:33.777074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:33.777509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:33.778267 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:33.778723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:33.779150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:33.920957 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.930715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.937041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:33.938576 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5eef5c49-5252-4e9e-a516-6099171cce06 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.173942 Sep 28 15:44:33.939234 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 231/459] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:33 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:34.976980 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:34.977744 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:34.984881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:34.985391 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:34.985822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:34.986533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:34.986978 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:34.987395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:35.133646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:35.143180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:35.145825 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:35.147523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fe16de09-5e73-45b0-ab32-279530b6e818 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.175158 Sep 28 15:44:35.148441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 229/460] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:34 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:36.172795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:36.173566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:36.180832 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:36.181324 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:36.181753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:36.182488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:36.182936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:36.183361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:36.320428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.333295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.334759 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:36.335938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7f875ed8-20df-4466-9b8f-ead10d962660 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.167232 Sep 28 15:44:36.336710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 232/461] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:36 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:37.360859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:37.361471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:37.367807 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:37.368288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:37.368727 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:37.369422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:37.369961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:37.371048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:37.569640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:37.580800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:37.582281 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:37.583746 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3993c707-faa3-4aed-8a89-0566b34df912 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.226921 Sep 28 15:44:37.585000 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 230/462] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:37 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:38.630558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:38.631212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:38.656384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:38.657163 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:38.657790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:38.658730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:38.659366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:38.659970 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:38.816334 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.825764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.827611 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:38.829038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-103862e6-9dcf-4475-a075-9cb9aa3e78bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.203525 Sep 28 15:44:38.830384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 233/463] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:38 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:39.854281 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:39.854879 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:39.861204 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:39.861712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:39.862189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:39.862874 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:39.863321 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:39.863742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:39.992922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.001585 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.003021 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:40.004162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-17cd0a70-03df-4349-b90f-82b270c25adf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.153990 Sep 28 15:44:40.004703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 231/464] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:39 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:41.029811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:41.030420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:41.032793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=56 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:41.038918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:41.039394 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:41.039822 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:41.040506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:41.040953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:41.041381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:41.179185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:41.187971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:41.189410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:41.190601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1273f417-11e4-4611-a07a-d0a73b97ddc6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.164833 Sep 28 15:44:41.191153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 234/465] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:41 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:42.215730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:42.216282 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:42.222728 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:42.223415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:42.223850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:42.224539 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:42.224984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:42.225402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:42.435882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.445420 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.446867 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:42.448018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4f9af396-6852-4cb6-afc7-8e58f4e27495 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.236324 Sep 28 15:44:42.448569 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 232/466] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:42 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:43.474282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:43.474836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:43.481354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:43.481837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:43.482306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:43.483002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:43.483455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:43.483878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:43.616298 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:43.625102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:43.626560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:43.627697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6925234d-6b65-4047-a431-532031cf24ce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.157467 Sep 28 15:44:43.628246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 235/467] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:43 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:44.652526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:44.653117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:44.660341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:44.660831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:44.661265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:44.662491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:44.662947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:44.663369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:44.791984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.800688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.802138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:44.803314 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-75918edc-b1d8-4231-9259-3ce0c67c8f88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.154662 Sep 28 15:44:44.803859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 233/468] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:44 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:45.827465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:45.828049 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:45.834635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:45.835109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:45.835536 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:45.836214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:45.836660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:45.837078 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:45.966694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:45.975711 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:45.977129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:45.978302 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-86880d76-a705-4e73-b682-527741f89371 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.154767 Sep 28 15:44:45.978858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 236/469] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:45 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:47.003506 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:47.004122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:47.010978 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:47.011460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:47.011898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:47.012589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:47.013045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:47.013470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:47.032606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:47.151010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:47.162052 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:47.162052 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:47.163178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cc7aaa81-5033-47ce-9c8c-319e486909fb tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.163645 Sep 28 15:44:47.171658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 234/470] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:46 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:48.188476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:48.189082 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:48.196193 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:48.196676 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:48.197184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:48.197947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:48.198407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:48.198833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:48.326048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.335158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.336622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:48.337771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-77a9681a-31a9-4947-abbb-1ac014c2686c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.153295 Sep 28 15:44:48.338357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 237/471] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:48 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:49.362728 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:49.363263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:49.369685 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:49.370198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:49.370628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:49.371561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:49.372006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:49.372424 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:49.505517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:49.514010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:49.515430 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:49.516568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1976e44f-8574-41fb-bbb5-6d4ace2732a1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.157780 Sep 28 15:44:49.517116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 235/472] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:49 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:50.542566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:50.543087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:50.549707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:50.550221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:50.550653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:50.551340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:50.551794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:50.552824 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:50.556722 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:50.681620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.690429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.691874 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:50.693041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fcc68486-7798-4c00-8207-0fb01bd8a491 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.154444 Sep 28 15:44:50.693599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 238/473] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:50 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:51.717616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:51.718254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:51.724638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:51.725119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:51.725553 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:51.726268 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:51.726708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:51.727126 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:51.887608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:51.900146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:51.903513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:51.904693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5c18326a-7cc9-48cc-9d14-08e9d55e1ea0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.190914 Sep 28 15:44:51.905248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 236/474] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:51 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:52.938198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:52.938198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:52.942934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:52.944085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:52.944610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:52.945541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:52.946092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:52.946579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:53.104909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.121375 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.122921 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:53.124155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cf77d82d-82b7-4cd3-9483-bfaa2aad1d60 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.194370 Sep 28 15:44:53.124799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 239/475] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:52 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:54.151020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:54.151996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:54.158088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:54.158608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:54.159044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:54.159737 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:54.160186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:54.160607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:54.297280 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.305767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.307220 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:54.308368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7c2d5840-27d2-4ead-b0c6-460a7d56c88f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.162336 Sep 28 15:44:54.308921 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 237/476] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:54 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:55.335518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:55.336124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:55.343139 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:55.343633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:55.344085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:55.344740 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:55.345194 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:55.345602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:55.478342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:55.486899 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:55.488332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:55.489482 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6320715f-5a75-46b1-8028-2e0562c1768d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.158710 Sep 28 15:44:55.490084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 240/477] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:55 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:56.513757 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:56.514398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:56.520803 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:56.521275 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:56.521741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.522451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:56.522931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:56.523349 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:56.680175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.689672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.692109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:56.693810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b37c2252-154a-49c1-9e7b-bb94ba81fa86 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.183816 Sep 28 15:44:56.694601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 238/478] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:56 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:57.719340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:57.720061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:57.727385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.727868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.728304 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.729003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:57.729455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:57.729906 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:57.868653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.877688 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.879410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:57.880561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-26fbf047-6f20-4365-945c-478977ed624d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.165159 Sep 28 15:44:57.881679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 241/479] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:57 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:44:58.283469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-5c09dced-0e1d-421b-9232-5c3b57f77c52 req-093e4d7a-9043-4d59-a638-b9e2b024f75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "name": "network-vif-plugged", "status": "completed", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:44:58.300380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=26 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:44:58.302738 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-5c09dced-0e1d-421b-9232-5c3b57f77c52 req-093e4d7a-9043-4d59-a638-b9e2b024f75d service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:58.303330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-5c09dced-0e1d-421b-9232-5c3b57f77c52 req-093e4d7a-9043-4d59-a638-b9e2b024f75d service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:58.303920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-5c09dced-0e1d-421b-9232-5c3b57f77c52 req-093e4d7a-9043-4d59-a638-b9e2b024f75d service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:58.315823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-5c09dced-0e1d-421b-9232-5c3b57f77c52 req-093e4d7a-9043-4d59-a638-b9e2b024f75d service nova] Creating event network-vif-plugged:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:44:58.320918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-5c09dced-0e1d-421b-9232-5c3b57f77c52 req-093e4d7a-9043-4d59-a638-b9e2b024f75d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041147 Sep 28 15:44:58.321940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 239/480] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:44:58.907236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:44:58.908131 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:44:58.914665 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:58.915148 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:58.915581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:58.916276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:44:58.917345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:44:58.917822 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:44:59.070218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:59.078982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:59.080426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:44:59.081583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-810c7e73-368c-420c-9f65-5b989eb453cf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.178851 Sep 28 15:44:59.082361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 242/481] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:44:58 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:45:00.107707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:00.108441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:00.114569 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.115049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.115981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.116666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.117114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.117535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.218877 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1208002871", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "networks": [{"uuid": "db2750e0-a7a8-471c-8c9d-9a849d0d357e"}]}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:00.247582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:00.256675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:00.258353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:00.259524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f6c676cb-8b54-4a9b-850d-22ef351bc8da tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1809 microversion: 2.20 time: 0.156611 Sep 28 15:45:00.260064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 240/482] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:45:00 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:45:00.274074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] validate_networks() for [('db2750e0-a7a8-471c-8c9d-9a849d0d357e', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:45:00.624799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:45:00.625223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:45:00.625695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:45:00.626126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:45:00.626534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:45:00.635593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.636074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.636503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.637222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:00.637797 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:00.638407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:00.655624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Getting quotas for project 6dcadaaec3664e8dace58c2479d8f534. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:00.659602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Getting quotas for user de27b2da998a4728b07fccfb12294e3d and project 6dcadaaec3664e8dace58c2479d8f534. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:00.671927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:45:00.674256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:45:00.720881 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3d333481-7b4e-433c-ac1f-01826d7f5795 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505810 Sep 28 15:45:00.721522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 243/483] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:45:00.732872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b7e4c2c2-1d4e-4eac-847d-e36b1885fb7b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:00.733478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b7e4c2c2-1d4e-4eac-847d-e36b1885fb7b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:00.792776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b7e4c2c2-1d4e-4eac-847d-e36b1885fb7b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:00.799981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b7e4c2c2-1d4e-4eac-847d-e36b1885fb7b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1219 microversion: 2.1 time: 0.070772 Sep 28 15:45:00.800682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 241/484] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:00 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:01.294046 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:01.294659 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:01.301886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.302380 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.303321 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.304095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.304725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.305150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.439982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:01.449332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:01.450809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:01.451969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ef30964a-e100-47a0-9a1b-bee285c1c32c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1796 microversion: 2.20 time: 0.162434 Sep 28 15:45:01.452662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 244/485] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:45:01 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:45:01.822584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:01.823189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:01.830048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.830532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.830966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.831644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:01.832091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:01.832507 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:01.892386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:01.899968 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3177008e-d2a5-4f7c-9524-018f1cd761a0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1271 microversion: 2.1 time: 0.081167 Sep 28 15:45:01.900515 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 242/486] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:01 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:02.923107 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:02.923876 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:02.930842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:02.931446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:02.931875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:02.932562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:02.933011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:02.933429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:03.126697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:03.135462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-88adc3a4-5ca7-4c9c-87dc-ce8082e3d12c tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.216159 Sep 28 15:45:03.136039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 245/487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:02 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:03.464995 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-35237626-4553-4010-be68-83cc58169cda req-5ef3e8f5-6ad3-445e-b25f-d185589686f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692d866e-d4bb-492f-8b83-d51698930cc9", "tag": "28f67cde-0b9a-4eaf-9fc3-3751023e941e"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:03.476292 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-35237626-4553-4010-be68-83cc58169cda req-5ef3e8f5-6ad3-445e-b25f-d185589686f2 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:03.476759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-35237626-4553-4010-be68-83cc58169cda req-5ef3e8f5-6ad3-445e-b25f-d185589686f2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:03.477309 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-35237626-4553-4010-be68-83cc58169cda req-5ef3e8f5-6ad3-445e-b25f-d185589686f2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:03.496271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-35237626-4553-4010-be68-83cc58169cda req-5ef3e8f5-6ad3-445e-b25f-d185589686f2 service nova] Creating event network-changed:28f67cde-0b9a-4eaf-9fc3-3751023e941e for instance 692d866e-d4bb-492f-8b83-d51698930cc9 on hv-cinder-85931 Sep 28 15:45:03.501059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-35237626-4553-4010-be68-83cc58169cda req-5ef3e8f5-6ad3-445e-b25f-d185589686f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040282 Sep 28 15:45:03.501814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 243/488] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:04.158855 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:04.159373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:04.166133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:04.166615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:04.167075 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:04.167771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:04.168226 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:04.168650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:04.293562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:04.301321 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ad1921fc-03f5-47d1-8f06-a8a86c813fb7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.146407 Sep 28 15:45:04.301890 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 246/489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:04 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:05.325470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:05.326185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:05.332219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:05.332701 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:05.333134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:05.334434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:05.334891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:05.335304 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:05.537471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:05.545087 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6259f5a7-5d8d-4c66-939b-a4e0cc4e777d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.224201 Sep 28 15:45:05.545645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 244/490] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:05 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:06.568257 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:06.568891 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:06.574915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.575388 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.575811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.576493 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:06.576940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:06.577357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:06.708029 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:06.717482 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-94f7ece0-57a0-4858-bbf8-6fae1a55ffd0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.153177 Sep 28 15:45:06.718092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 247/491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:06 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:07.741503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:07.742131 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:07.748504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:07.749045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:07.749545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:07.750259 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:07.750717 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:07.751137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:07.878547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:07.886105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0f90115c-18dd-41c6-a31e-1e1859b79535 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.149060 Sep 28 15:45:07.886672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 245/492] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:07 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:08.226892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-163472ac-f3b7-4965-99f3-1b1bf66f710e req-82ebbffe-2f70-41b6-85ee-463201fcf3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692d866e-d4bb-492f-8b83-d51698930cc9", "name": "network-vif-plugged", "status": "completed", "tag": "28f67cde-0b9a-4eaf-9fc3-3751023e941e"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:08.236508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-163472ac-f3b7-4965-99f3-1b1bf66f710e req-82ebbffe-2f70-41b6-85ee-463201fcf3e6 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.236979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-163472ac-f3b7-4965-99f3-1b1bf66f710e req-82ebbffe-2f70-41b6-85ee-463201fcf3e6 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.237404 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-163472ac-f3b7-4965-99f3-1b1bf66f710e req-82ebbffe-2f70-41b6-85ee-463201fcf3e6 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.249158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-163472ac-f3b7-4965-99f3-1b1bf66f710e req-82ebbffe-2f70-41b6-85ee-463201fcf3e6 service nova] Creating event network-vif-plugged:28f67cde-0b9a-4eaf-9fc3-3751023e941e for instance 692d866e-d4bb-492f-8b83-d51698930cc9 on hv-cinder-85931 Sep 28 15:45:08.254031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-163472ac-f3b7-4965-99f3-1b1bf66f710e req-82ebbffe-2f70-41b6-85ee-463201fcf3e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Sep 28 15:45:08.254610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 248/493] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:08.908755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:08.909364 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:08.915798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.916267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.916694 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.917372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.917816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.918253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.938082 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:08.938657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:08.945456 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.945959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.946395 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.947086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.947536 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.947971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.971326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d6a12164-8827-4d23-bd70-2e7e9f70d299 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/ips" status: 200 len: 150 microversion: 2.1 time: 0.037363 Sep 28 15:45:08.971905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 249/494] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:45:08 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:45:08.983114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d474fdb7-a57f-4694-a3b9-d5080af64a9f"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:08.985407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:08.991732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.992212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.992646 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:08.993340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:08.993788 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:08.994239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.046911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:09.054976 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-869fe448-5292-45de-a6a7-370b9338092d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.150123 Sep 28 15:45:09.055542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 246/495] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:08 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:09.077189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Invalid volume: volume d474fdb7-a57f-4694-a3b9-d5080af64a9f is already attached to instances: 38cb3a9e-72d1-4502-90fe-35576e05e0a2 Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: POST /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/os-volume_attachments HTTP/1.1 Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 74 Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:45:09.078981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {"volumeAttachment": {"volumeId": "d474fdb7-a57f-4694-a3b9-d5080af64a9f"}} Sep 28 15:45:09.080591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Invalid volume: volume d474fdb7-a57f-4694-a3b9-d5080af64a9f is already attached to instances: 38cb3a9e-72d1-4502-90fe-35576e05e0a2 Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'server_id': '67dc05ad-5958-4041-9643-9646838091a5', 'body': {'volumeAttachment': {'volumeId': 'd474fdb7-a57f-4694-a3b9-d5080af64a9f'}}} Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d474fdb7-a57f-4694-a3b9-d5080af64a9f is already attached to instances: 38cb3a9e-72d1-4502-90fe-35576e05e0a2 Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.081657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d474fdb7-a57f-4694-a3b9-d5080af64a9f is already attached to instances: 38cb3a9e-72d1-4502-90fe-35576e05e0a2 Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:09.083079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d474fdb7-a57f-4694-a3b9-d5080af64a9f is already attached to instances: 38cb3a9e-72d1-4502-90fe-35576e05e0a2 Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 400 to user: Invalid volume: volume d474fdb7-a57f-4694-a3b9-d5080af64a9f is already attached to instances: 38cb3a9e-72d1-4502-90fe-35576e05e0a2 {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-39d7666e-0013-46dd-9eb5-0852ebfec976 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101049 Sep 28 15:45:09.084990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 250/496] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:45:08 2022] POST /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:45:09.089239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:09.089791 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:09.095673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.096149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.096579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.097260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.097706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.098150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.124594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:45:09.203235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-97bc7288-4415-404c-88ec-30baac966df4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 204 len: 0 microversion: 2.1 time: 0.117548 Sep 28 15:45:09.203799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 247/497] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:45:09 2022] DELETE /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:45:09.212472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:09.213080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:09.220824 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.221337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.221778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.222558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:09.223022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:09.223448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:09.356575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:09.364471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5bd269e1-4cc8-45cd-8959-8dda6acf0adb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1680 microversion: 2.1 time: 0.156224 Sep 28 15:45:09.365637 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 251/498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:09 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:10.080274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:10.080998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:10.088171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.088650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.089082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.089764 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.090241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.090661 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.216630 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:10.224218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-34e97117-b23c-4f9a-a21a-3b24eacec56b tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1319 microversion: 2.1 time: 0.148129 Sep 28 15:45:10.224821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 248/499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:10 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:10.389760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:10.390316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:10.396904 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.397372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.397797 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.398505 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:10.398953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:10.399387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:10.528121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:10.535792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-609780a3-2a09-4f1c-9afe-16eaf91fd570 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1680 microversion: 2.1 time: 0.149991 Sep 28 15:45:10.536379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 252/500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:10 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:11.247707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:11.248418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:11.250484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:11.257300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:11.257780 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:11.258510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:11.258940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:11.259912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:11.260347 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:11.386844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:11.394447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e8a8fe53-2b36-442e-b0aa-ce4bacdb8f71 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1508 microversion: 2.1 time: 0.151216 Sep 28 15:45:11.395004 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 249/501] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:11 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:11.560131 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:11.560828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:11.562658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:11.563629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:11.564779 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:11.569729 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:11.570245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:11.570689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:11.571378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:11.571828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:11.572247 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:12.051068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:12.059399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9804d5bf-280e-4717-9e68-11574c786722 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1680 microversion: 2.1 time: 0.503190 Sep 28 15:45:12.059960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 253/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:11 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1680 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:12.737465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-273823f0-421a-41e0-86c6-b2dde0e527cb req-2cbaf90f-e94b-494c-b962-be149355d3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67dc05ad-5958-4041-9643-9646838091a5", "name": "network-vif-deleted", "tag": "8a0e2173-599b-42d5-a1a1-8e65b893783f"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:12.747952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-273823f0-421a-41e0-86c6-b2dde0e527cb req-2cbaf90f-e94b-494c-b962-be149355d3da service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:12.748683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-273823f0-421a-41e0-86c6-b2dde0e527cb req-2cbaf90f-e94b-494c-b962-be149355d3da service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:12.749279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-273823f0-421a-41e0-86c6-b2dde0e527cb req-2cbaf90f-e94b-494c-b962-be149355d3da service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:12.771223 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-273823f0-421a-41e0-86c6-b2dde0e527cb req-2cbaf90f-e94b-494c-b962-be149355d3da service nova] Creating event network-vif-deleted:8a0e2173-599b-42d5-a1a1-8e65b893783f for instance 67dc05ad-5958-4041-9643-9646838091a5 on hv-cinder-85931 Sep 28 15:45:12.776305 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-273823f0-421a-41e0-86c6-b2dde0e527cb req-2cbaf90f-e94b-494c-b962-be149355d3da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042472 Sep 28 15:45:12.776977 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 250/503] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:45:13.085516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:13.086208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:13.093109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.093915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.094551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:13.095890 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.096581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.097577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:13.145591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:13.146385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:13.146882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:13.147617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lazy-loading 'fault' on Instance uuid 67dc05ad-5958-4041-9643-9646838091a5 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:13.201604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:13.210610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1d48a49a-f741-4397-a7ca-c7dd0b1785e5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 200 len: 1330 microversion: 2.1 time: 0.128927 Sep 28 15:45:13.211433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 254/504] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:13 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:14.237422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:14.238184 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:14.245207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:14.245971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:14.246414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:14.247115 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:14.247571 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:14.247993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:14.263382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 HTTP/1.1 Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:45:14.265053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:45:14.266405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '67dc05ad-5958-4041-9643-9646838091a5'} Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:45:14.267142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:45:14.268346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:14.269436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:45:14.269436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-52b2e70e-9b0c-436a-93ea-f3fe9622be73 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 404 len: 111 microversion: 2.1 time: 0.034396 Sep 28 15:45:14.269436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 251/505] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:14 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:45:14.276546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f5270fd3-c977-44b0-ae95-d0570a3481a0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '.version_select at 0x7f1154faa9d0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:14.299579 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f5270fd3-c977-44b0-ae95-d0570a3481a0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687395015" status: 202 len: 0 microversion: 2.1 time: 0.026722 Sep 28 15:45:14.300203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 255/506] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 15:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687395015 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:14.978363 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:14.978857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:14.985937 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:14.986428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:14.986860 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:14.987568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:14.988023 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:14.988447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.120180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lazy-loading 'services' on Instance uuid 38cb3a9e-72d1-4502-90fe-35576e05e0a2 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:15.153953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:15.232195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0103e83a-2cd3-4408-8512-eb3a44da236f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments/d474fdb7-a57f-4694-a3b9-d5080af64a9f" status: 202 len: 0 microversion: 2.1 time: 0.258133 Sep 28 15:45:15.232786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 252/507] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:45:14 2022] DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments/d474fdb7-a57f-4694-a3b9-d5080af64a9f => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:15.242561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:15.245631 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:15.255930 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:15.256819 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:15.257257 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.257993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:15.258443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:15.258859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:15.294034 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ec94b499-3cf3-4f6d-b9f7-464e834e2201 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056771 Sep 28 15:45:15.294615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 256/508] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:45:15 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:16.307762 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:16.310137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:16.316993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.317466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.317920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.319324 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.319838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.320260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.350172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e6fc8144-daff-455e-99f6-1e3dc6967078 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047505 Sep 28 15:45:16.350765 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 253/509] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:45:16 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:45:16.425892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:16.426426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:16.433658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.434169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.434597 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.435277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.435720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.436138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.440070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=100 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:16.462458 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:45:16.537481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-eaba0204-a25c-4075-9371-c8338df38e27 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 204 len: 0 microversion: 2.1 time: 0.115083 Sep 28 15:45:16.538100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 257/510] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:45:16 2022] DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:45:16.547493 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:16.548041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:16.554422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.554904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.555330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.556016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:16.556462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:16.556883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:16.690145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:16.698572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4646da92-13c7-4e38-af8f-92ad1e392e7e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1681 microversion: 2.1 time: 0.156051 Sep 28 15:45:16.699107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 254/511] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:16 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:17.722437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:17.723127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:17.729552 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:17.730065 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:17.730496 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:17.735758 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:17.736329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:17.736774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:17.866827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:17.875636 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9cad76ce-3812-46e5-9ffd-28b14c9dd322 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1681 microversion: 2.1 time: 0.157408 Sep 28 15:45:17.876314 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 258/512] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:17 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:18.899410 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:18.899986 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:18.906234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:18.906707 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:18.910203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:18.911091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:18.911563 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:18.912012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.135914 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:19.143466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-68109d5e-f827-437d-b479-9f36fe12f17e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1681 microversion: 2.1 time: 0.248027 Sep 28 15:45:19.144021 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 255/513] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:18 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:19.511092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-b9acb2cc-e3e6-4dba-9d8a-150636aeb797 req-915af804-27b9-4f6b-815e-20913edda9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cb3a9e-72d1-4502-90fe-35576e05e0a2", "name": "network-vif-deleted", "tag": "0fdce35c-d94c-4241-8f30-04b6de93d44d"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:19.521257 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b9acb2cc-e3e6-4dba-9d8a-150636aeb797 req-915af804-27b9-4f6b-815e-20913edda9b4 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:19.521728 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b9acb2cc-e3e6-4dba-9d8a-150636aeb797 req-915af804-27b9-4f6b-815e-20913edda9b4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:19.522175 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b9acb2cc-e3e6-4dba-9d8a-150636aeb797 req-915af804-27b9-4f6b-815e-20913edda9b4 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:19.533373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-b9acb2cc-e3e6-4dba-9d8a-150636aeb797 req-915af804-27b9-4f6b-815e-20913edda9b4 service nova] Creating event network-vif-deleted:0fdce35c-d94c-4241-8f30-04b6de93d44d for instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 on hv-cinder-85931 Sep 28 15:45:19.538326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-b9acb2cc-e3e6-4dba-9d8a-150636aeb797 req-915af804-27b9-4f6b-815e-20913edda9b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Sep 28 15:45:19.538946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 259/514] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:20.167619 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:20.168829 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:20.175199 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.175676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.176108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.176798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.177245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.177665 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.207616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:20.208205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:20.208413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.208897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.209328 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.209772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lazy-loading 'fault' on Instance uuid 38cb3a9e-72d1-4502-90fe-35576e05e0a2 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:20.218133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.218791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.219346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.229764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:20.231290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:20.231739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:20.272183 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:20.293266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-32b6c691-c185-4d5a-96d4-87abb05d641b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 200 len: 1331 microversion: 2.1 time: 0.129773 Sep 28 15:45:20.303180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 256/515] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:20 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:20.409468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lazy-loading 'services' on Instance uuid 8ac91576-c5d2-418a-a1c5-af43fccf4e46 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:20.544651 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-22728da9-8637-4b32-8c0a-217ec33cf1bb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-volume_attachments/7686b4b8-36aa-4121-8aa1-d6b8c81fa1e3" status: 202 len: 0 microversion: 2.1 time: 0.341195 Sep 28 15:45:20.545285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 260/516] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:45:20 2022] DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-volume_attachments/7686b4b8-36aa-4121-8aa1-d6b8c81fa1e3 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:21.324994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:21.325589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:21.332247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.332826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.333599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.334717 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.335343 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.335925 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.352596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 HTTP/1.1 Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:45:21.355622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:45:21.356917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '38cb3a9e-72d1-4502-90fe-35576e05e0a2'} Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:45:21.357635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:45:21.358805 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:21.359849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:45:21.359849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-293d7c66-dfbe-4b49-9152-df7dbda1ea1d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 404 len: 111 microversion: 2.1 time: 0.036457 Sep 28 15:45:21.359849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 257/517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:21 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:45:21.368191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e0b4479c-8607-425a-a887-036e4f6fcf2e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '.version_select at 0x7f1154f8d670>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:21.390951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e0b4479c-8607-425a-a887-036e4f6fcf2e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054732049" status: 202 len: 0 microversion: 2.1 time: 0.026876 Sep 28 15:45:21.391559 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 261/518] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 15:45:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054732049 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:45:21.687234 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cd5e18ab-a655-4d23-9f22-f7726a8aa28a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:21.693149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd5e18ab-a655-4d23-9f22-f7726a8aa28a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.693743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd5e18ab-a655-4d23-9f22-f7726a8aa28a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.694271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cd5e18ab-a655-4d23-9f22-f7726a8aa28a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.717903 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cd5e18ab-a655-4d23-9f22-f7726a8aa28a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Going to try to stop instance {{(pid=127073) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 15:45:21.764418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cd5e18ab-a655-4d23-9f22-f7726a8aa28a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action" status: 202 len: 0 microversion: 2.1 time: 0.081101 Sep 28 15:45:21.765319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 258/519] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:45:21 2022] POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:21.773746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:21.774661 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:21.782477 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.782972 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.783400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.784298 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:21.784968 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:21.785533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:21.922949 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:21.931916 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bb460d8b-0a71-410a-a560-459d779240cd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.162583 Sep 28 15:45:21.932511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 262/520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:21 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:22.041743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d8593809-f47b-4089-9db8-e69929e42c4f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: .version_select at 0x7f1154e8d550>, body: {"keypair": {"name": "tempest-keypair-704133159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYFPfbxH/M9D06EoTv9KkJ4K/DvF4E4vE+Ym3VM8CiyvDswSOfetx8+d/Uiz2hK9chutKB22RtIRcZg5hmehrE31yDotz7bvJxlqU5NpR30zkdHYtByNRuUX4k9J4Dn5w=="}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:22.057494 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-d8593809-f47b-4089-9db8-e69929e42c4f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:22.062190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-d8593809-f47b-4089-9db8-e69929e42c4f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:22.084596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d8593809-f47b-4089-9db8-e69929e42c4f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048096 Sep 28 15:45:22.085183 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 259/521] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:45:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:22.957262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:22.957802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:22.964731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:22.965214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:22.965649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:22.966366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:22.966821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:22.967259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:23.186770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:23.197358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8199ec26-e11c-4c15-9647-7d94bc39d9d9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.243967 Sep 28 15:45:23.198122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 263/522] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:22 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:23.264006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d61f4d0-6d45-4792-a6d0-882fa9237f5d"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:23.266401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:23.276722 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:23.277213 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:23.277651 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:23.278485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:23.278936 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:23.279360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:23.446574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2110084097", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df05fe18-9205-4e7c-b6d8-ac63aa67e1aa"}], "security_groups": [{"name": "tempest-securitygroup--2038529652"}], "key_name": "tempest-keypair-704133159", "user_data": "}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:23.550664 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-499d352c-61bd-45a6-b215-6756b67a81cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290532 Sep 28 15:45:23.555267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 260/523] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:45:23 2022] POST /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:23.574432 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] validate_networks() for [('df05fe18-9205-4e7c-b6d8-ac63aa67e1aa', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:45:23.966931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:45:23.967498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:45:23.967796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:45:23.968196 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:45:23.968598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:45:23.977836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:23.978334 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:23.978767 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:23.979486 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:23.979934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:23.980346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:23.996931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:45:24.001030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:45:24.012143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:45:24.014376 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:45:24.066573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-575335bb-b854-4f72-a94e-cd0887e10f90 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625756 Sep 28 15:45:24.067224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 264/524] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:45:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:45:24.079925 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fc4e93f0-49ef-41fc-8bbb-4fe312a4bcca tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:24.080623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fc4e93f0-49ef-41fc-8bbb-4fe312a4bcca tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:24.138603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fc4e93f0-49ef-41fc-8bbb-4fe312a4bcca tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:24.145467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fc4e93f0-49ef-41fc-8bbb-4fe312a4bcca tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1241 microversion: 2.1 time: 0.070062 Sep 28 15:45:24.146037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 261/525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:24 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:24.222622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:24.223356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:24.230446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:24.230923 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:24.231518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:24.232320 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:24.232826 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:24.233222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:24.372170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:24.383702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-47ad9bd0-f3c9-4ec5-8269-9a50b03ae9fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.165288 Sep 28 15:45:24.384279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 265/526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:24 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:25.169020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:25.169632 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:25.176970 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.177473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.177926 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.178609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.179056 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.180128 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.242084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:25.249778 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4296e7a7-0530-4b30-a7f4-1c6b8b010bb7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1293 microversion: 2.1 time: 0.084637 Sep 28 15:45:25.250354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 262/527] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:25 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:25.407726 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:25.408276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:25.415877 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.416379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.416806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.417684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:25.418162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:25.418585 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:25.808511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:25.818998 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8b5c0cfc-2786-4a94-9b5b-d480e540e7c6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.414635 Sep 28 15:45:25.825038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 266/528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:25 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:26.272463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:26.273643 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:26.280502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.280948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.281383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.282346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.282795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.283247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.491135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:26.500750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2ee68024-6b9f-42c4-9233-ff2deae37106 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.231939 Sep 28 15:45:26.501605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 263/529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:26 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:26.843982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:26.844704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:26.851285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.851858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.852357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:26.853114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:26.853649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:26.854164 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.074540 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:27.082155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b19e5476-39bb-40c1-8702-7ee7b0daceb1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.242089 Sep 28 15:45:27.082720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 267/530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:26 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:27.219580 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-f0d3d9f2-3f6e-4eb8-995f-6a06c7a01de7 req-797884ad-1083-4ae8-8dc1-f0b1b01ae392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90517e8-f8ed-480c-9005-afe1f77323e8", "tag": "83666e16-8db0-45d5-8036-9477437e4471"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:27.231745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-f0d3d9f2-3f6e-4eb8-995f-6a06c7a01de7 req-797884ad-1083-4ae8-8dc1-f0b1b01ae392 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.232300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-f0d3d9f2-3f6e-4eb8-995f-6a06c7a01de7 req-797884ad-1083-4ae8-8dc1-f0b1b01ae392 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.232816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-f0d3d9f2-3f6e-4eb8-995f-6a06c7a01de7 req-797884ad-1083-4ae8-8dc1-f0b1b01ae392 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.244191 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-f0d3d9f2-3f6e-4eb8-995f-6a06c7a01de7 req-797884ad-1083-4ae8-8dc1-f0b1b01ae392 service nova] Creating event network-changed:83666e16-8db0-45d5-8036-9477437e4471 for instance a90517e8-f8ed-480c-9005-afe1f77323e8 on hv-cinder-85931 Sep 28 15:45:27.250375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-f0d3d9f2-3f6e-4eb8-995f-6a06c7a01de7 req-797884ad-1083-4ae8-8dc1-f0b1b01ae392 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034616 Sep 28 15:45:27.251049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 264/531] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:27.525152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:27.526076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:27.532168 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.532649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.533082 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.533774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.534324 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.534747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.728443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:27.737191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cdaca087-e89e-48e8-998d-f327336a43af tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.216496 Sep 28 15:45:27.737774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 268/532] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:27 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:27.781613 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc9dd2c0-bad1-4d61-83bc-c4ef1973d97c", "device": "/dev/sdb"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:27.784608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:27.791669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.792149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.792582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:27.793261 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:27.793705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:27.794176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.106028 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:28.106668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:28.113262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.113746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.114211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.114899 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.115352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.115776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.246758 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:28.254695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8358c1d0-2318-4823-b898-d9248fc3752e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.152832 Sep 28 15:45:28.255263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 269/533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:28 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:28.762576 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:28.763187 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:28.769270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.769753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.770214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.770913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:28.771367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:28.771776 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:28.876966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1e94385e-47ef-4b7b-a1d4-8f61ac228973 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "POST /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.099229 Sep 28 15:45:28.878881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 265/534] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:45:27 2022] POST /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9/os-volume_attachments => generated 194 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:28.973984 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:28.982390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6aab0a0e-5e96-4b77-a5ad-f1d0ac4bda15 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.226615 Sep 28 15:45:28.983084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 270/535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:28 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:29.279203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:29.279814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:29.281732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:29.287330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.287815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.288273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.288967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:29.289417 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:29.289905 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:29.417503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:29.425100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-68b2d348-a2cd-4640-b0e3-87368d18d5c2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.150898 Sep 28 15:45:29.425664 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 266/536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:29 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:30.006064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:30.006703 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:30.013721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:30.014231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:30.014665 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:30.015351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:30.015826 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:30.016249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:30.145564 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:30.153271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8ea35b92-f9c0-4300-9700-78082efe5223 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.151107 Sep 28 15:45:30.153832 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 271/537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:30 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:30.448465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:30.449067 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:30.455550 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:30.456022 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:30.456447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:30.457127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:30.457573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:30.458018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:30.589616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:30.597204 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e05bf24a-1019-46c9-8f26-86c55bef0b1f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.152606 Sep 28 15:45:30.597755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 267/538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:30 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:31.123345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:31.125649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:31.132711 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.133186 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.133615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.134338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.134791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.135211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.158599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'flavor' on Instance uuid cbf736d9-c255-4f14-8763-4d61838297a8 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:31.176486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:31.177097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:31.184161 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.184646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.185081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.185770 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.186247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.186762 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.206223 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:31.240270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:31.286421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-201b0d36-f864-4c99-b486-f923648c0de1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/action" status: 200 len: 32 microversion: 2.1 time: 0.167102 Sep 28 15:45:31.287176 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 272/539] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:45:31 2022] POST /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:45:31.299444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:31.300273 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:31.307620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.308199 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.308720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.309521 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.310166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.310595 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.331291 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:31.339365 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3df683be-2741-4e96-807d-34201153f013 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.166608 Sep 28 15:45:31.340192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 268/540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:31 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:31.527571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:31.535869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1be240d3-0f21-46c5-b406-c5fbfb5d2ee1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.240698 Sep 28 15:45:31.536447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 273/541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:31 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:31.622435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:31.623042 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:31.628823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.629961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.630388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.631075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:31.631520 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:31.631935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:31.835552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:31.843239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-723f0f15-c976-46fc-8d5a-e248319bce92 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1677 microversion: 2.1 time: 0.224788 Sep 28 15:45:31.843820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 269/542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:31 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:32.361326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-b7621ddc-c98a-4816-8225-3f5384163c43 req-704c0ec5-9f40-4674-b88c-f0d3e48fad8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90517e8-f8ed-480c-9005-afe1f77323e8", "name": "network-vif-plugged", "status": "completed", "tag": "83666e16-8db0-45d5-8036-9477437e4471"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:32.362217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:32.362834 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:32.370540 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.371027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.371465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.372158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.372609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.373034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.374730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b7621ddc-c98a-4816-8225-3f5384163c43 req-704c0ec5-9f40-4674-b88c-f0d3e48fad8c service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.375216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b7621ddc-c98a-4816-8225-3f5384163c43 req-704c0ec5-9f40-4674-b88c-f0d3e48fad8c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.375814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b7621ddc-c98a-4816-8225-3f5384163c43 req-704c0ec5-9f40-4674-b88c-f0d3e48fad8c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.387820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-b7621ddc-c98a-4816-8225-3f5384163c43 req-704c0ec5-9f40-4674-b88c-f0d3e48fad8c service nova] Creating event network-vif-plugged:83666e16-8db0-45d5-8036-9477437e4471 for instance a90517e8-f8ed-480c-9005-afe1f77323e8 on hv-cinder-85931 Sep 28 15:45:32.393299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-b7621ddc-c98a-4816-8225-3f5384163c43 req-704c0ec5-9f40-4674-b88c-f0d3e48fad8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035744 Sep 28 15:45:32.394300 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 274/543] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:32.519449 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:32.529031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b38820b0-6e62-4b1e-8433-4eab7c2cb69e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.170520 Sep 28 15:45:32.529691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 270/544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:32 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:32.559155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:32.559937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:32.566140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.566622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.567056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.567756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.568206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.568632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.724956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:32.733180 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-17058f65-f9d4-43a0-be6c-ddf88f6cdcc7 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.178240 Sep 28 15:45:32.733736 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 275/545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:32 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:32.868011 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:32.868611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:32.874889 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.875371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.875803 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:32.876488 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:32.876939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:32.877360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.002166 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:33.010348 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9a045b33-6d72-49a9-9cb6-d52b77fcc618 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1654 microversion: 2.1 time: 0.146712 Sep 28 15:45:33.010898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 271/546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:32 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:33.032533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-08aa80ea-ae55-4a5b-ac88-7d674331fa9d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:33.038470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08aa80ea-ae55-4a5b-ac88-7d674331fa9d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.038947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08aa80ea-ae55-4a5b-ac88-7d674331fa9d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.039381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-08aa80ea-ae55-4a5b-ac88-7d674331fa9d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.098652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-08aa80ea-ae55-4a5b-ac88-7d674331fa9d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Going to try to start instance {{(pid=127074) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 15:45:33.140475 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-08aa80ea-ae55-4a5b-ac88-7d674331fa9d tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action" status: 202 len: 0 microversion: 2.1 time: 0.111455 Sep 28 15:45:33.141690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 276/547] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:45:33 2022] POST /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:33.149997 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:33.150611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:33.156457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.156939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.157384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.158128 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.158583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.158982 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.291251 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:33.299018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8799af2d-41a7-425f-8e58-3362fe334e98 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1663 microversion: 2.1 time: 0.153177 Sep 28 15:45:33.299584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 272/548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:33 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:33.553072 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:33.553792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:33.559944 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.560428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.560862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.561543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.562027 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.562479 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.692823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:33.700566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3bb3c4bb-b29f-4ffb-8fb0-b6ff9d0b006a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1367 microversion: 2.1 time: 0.152089 Sep 28 15:45:33.701167 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 277/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:33 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:33.757435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:33.758073 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:33.764378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.764859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.765874 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.766617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:33.767072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:33.767495 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:33.924673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:33.932821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-07a8a539-4bec-4aae-8084-92946629cf76 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.179376 Sep 28 15:45:33.933383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 273/550] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:33 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:34.323128 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:34.323735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:34.325725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:34.326400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:34.332372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.332868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.333280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.333986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.334435 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.334857 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.496979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:34.504834 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bd033ea9-68cc-447f-a96c-5a6b9178b46e tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1663 microversion: 2.1 time: 0.186177 Sep 28 15:45:34.505395 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 278/551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:34 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1663 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:34.723431 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:34.724208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:34.726645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:34.732134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.732624 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.733061 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.733755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.734326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.734753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.956480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:34.957145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:34.964019 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.964422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.964853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:34.965551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:34.966038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:34.966462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.205087 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:35.208377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:35.213526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4854d6d8-1d78-4e14-9f06-901d2ffbd4f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1558 microversion: 2.1 time: 0.494000 Sep 28 15:45:35.214299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 274/552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:34 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1558 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:35.217253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3a3d0d71-6554-46c0-b4ed-e6ae68c1ac54 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.264833 Sep 28 15:45:35.217812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 279/553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:34 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:35.236859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:35.237344 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:35.243076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.243547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.244010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.244933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.245387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.245808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.324064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-48720585-f5ba-4c8c-bb8e-2b96605b5e1e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090841 Sep 28 15:45:35.324652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 275/554] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:45:35 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:35.529381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:35.530013 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:35.536028 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.536503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.536931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.537614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:35.538591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:35.539012 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:35.776689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:35.784393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b90d7071-3196-420c-b273-a5bcb847df91 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1663 microversion: 2.1 time: 0.259081 Sep 28 15:45:35.784958 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 280/555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:35 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1663 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:36.241299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:36.241928 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:36.248071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.248555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.248993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.249689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.250173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.250599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.375525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-75fcd367-caa4-425f-9959-8d7b5cfc7fa8 req-c87c8cf4-38cf-436a-9279-9e5139f94c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90517e8-f8ed-480c-9005-afe1f77323e8", "tag": "83666e16-8db0-45d5-8036-9477437e4471"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:36.386938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-75fcd367-caa4-425f-9959-8d7b5cfc7fa8 req-c87c8cf4-38cf-436a-9279-9e5139f94c5c service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.387691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-75fcd367-caa4-425f-9959-8d7b5cfc7fa8 req-c87c8cf4-38cf-436a-9279-9e5139f94c5c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.388293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-75fcd367-caa4-425f-9959-8d7b5cfc7fa8 req-c87c8cf4-38cf-436a-9279-9e5139f94c5c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.402398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-75fcd367-caa4-425f-9959-8d7b5cfc7fa8 req-c87c8cf4-38cf-436a-9279-9e5139f94c5c service nova] Creating event network-changed:83666e16-8db0-45d5-8036-9477437e4471 for instance a90517e8-f8ed-480c-9005-afe1f77323e8 on hv-cinder-85931 Sep 28 15:45:36.407764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-75fcd367-caa4-425f-9959-8d7b5cfc7fa8 req-c87c8cf4-38cf-436a-9279-9e5139f94c5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035734 Sep 28 15:45:36.408548 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 281/556] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:36.429577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:36.437876 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-691a6f23-fdff-4b04-b5f6-35ac59bd9a38 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.201184 Sep 28 15:45:36.438456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 276/557] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:36 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:36.808661 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:36.809448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:36.815597 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.816074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.816500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.817181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:36.817628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:36.818072 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:36.951784 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:36.959774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d3664f33-c64a-49cd-a402-365589d3c8d6 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1667 microversion: 2.1 time: 0.155122 Sep 28 15:45:36.960959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 282/558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:36 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:37.463502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:37.464334 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:37.472282 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.473558 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.474150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.474960 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:37.476387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:37.477097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:37.672802 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:37.684065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7d5370e7-92f0-481c-834f-be233f59978f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.226879 Sep 28 15:45:37.700261 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 277/559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:37 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:38.706858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:38.707533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:38.714693 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.715180 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.715611 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.716421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:38.716881 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:38.717323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:38.851274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:38.864421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6dfcc5fe-30b3-40cc-bb7b-3f94d84a3259 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.161293 Sep 28 15:45:38.864990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 283/560] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:38 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:39.887776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:39.888379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:39.894768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.895246 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.895677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:39.896359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:39.896812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:39.897231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:40.031036 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:40.039784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9b7b58e6-b9f6-428b-981a-4581f0947f55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.155947 Sep 28 15:45:40.040342 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 278/561] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:39 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:41.063809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:41.064412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:41.072314 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:41.072790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:41.073226 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:41.073938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:41.074387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:41.074805 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:41.211739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:41.219882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d612593d-cbc9-450d-8bdf-a234e0353287 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.160262 Sep 28 15:45:41.220446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 284/562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:41 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:42.242387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:42.242911 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:42.249559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:42.250066 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:42.250497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.251174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:42.251620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:42.252038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:42.381583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:42.389762 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ab5b5f99-444b-4ece-ba86-d5ac8296d66d tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.151385 Sep 28 15:45:42.390340 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 279/563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:42 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:43.413592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:43.414221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:43.416733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:43.422030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.422507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.422936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.423675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:43.424146 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:43.424565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:43.554658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:43.562835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b9ea48eb-6d13-4621-aa86-6602dea61f64 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.153756 Sep 28 15:45:43.563385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 285/564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:43 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:44.586112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:44.586719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:44.593065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.593537 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.594005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.594693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:44.595177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:44.595602 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:44.720684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:44.729366 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-34accf3e-5211-4295-9e7f-2ad0fda70a63 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.147148 Sep 28 15:45:44.729948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 280/565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:44 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:45.751771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:45.752357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:45.759539 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.760016 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.760442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.761124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:45.761575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:45.762029 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:45.891768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:45.899873 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1045226a-5e28-430f-b0b6-fb2d47e5fc96 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.151940 Sep 28 15:45:45.900434 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 286/566] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:45 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:46.922921 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:46.923541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:46.930445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:46.930943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:46.931369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:46.932043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:46.932489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:46.932916 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:47.057359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:47.065739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bdf947d9-05d1-4aff-8c01-2ca315bcf8e2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.146657 Sep 28 15:45:47.066411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 281/567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:46 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:48.089433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:48.090070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:48.096516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.096996 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.097431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.098150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:48.098609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:48.099033 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:48.229018 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:48.237103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-395f2218-ed4f-4f76-bdb5-1e100306a360 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.152131 Sep 28 15:45:48.237665 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 287/568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:48 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:49.260148 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:49.260820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:49.267095 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.267550 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.267981 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:49.268661 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:49.269105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:49.269522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:49.399907 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:49.407967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8dcdff38-cb67-4ab9-8e40-9787c9e662b2 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.151624 Sep 28 15:45:49.408527 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 282/569] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:49 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:50.432493 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:50.433221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:50.439950 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:50.440503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:50.440940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:50.441635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:50.442178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:50.442597 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:50.570698 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:50.574095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:50.579553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-39b64de7-deab-4d3b-b7e6-81ebe9b51852 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.151406 Sep 28 15:45:50.580120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 288/570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:50 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:51.602888 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:51.603490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:51.609878 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.610351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.610845 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.611592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:51.612112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:51.612526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:51.742812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:51.751291 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0a1a22fe-a60d-4617-8dfc-568b5fb954ca tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.152504 Sep 28 15:45:51.751898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 283/571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:51 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:52.776742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:52.777337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:52.785873 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.786350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.786781 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.787470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:52.787920 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:52.788338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:52.938107 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:52.946191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cc7b1552-5cda-4db0-9270-1578f357449b tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1735 microversion: 2.1 time: 0.173238 Sep 28 15:45:52.946752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 289/572] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:52 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:53.697217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:53.697710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:53.704055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.704526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.704948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:53.705627 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.706099 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.706514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:53.784982 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lazy-loading 'services' on Instance uuid 692d866e-d4bb-492f-8b83-d51698930cc9 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:53.844922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:45:53.855955 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7bfbe9a2-0dba-4c68-b9e5-dfa4c3030cde tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9/os-volume_attachments/fc9dd2c0-bad1-4d61-83bc-c4ef1973d97c" status: 202 len: 0 microversion: 2.1 time: 0.163452 Sep 28 15:45:53.856561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 284/573] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:45:53 2022] DELETE /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9/os-volume_attachments/fc9dd2c0-bad1-4d61-83bc-c4ef1973d97c => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:53.969231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:53.969836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:53.976338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.976808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.977233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:53.977945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:53.978395 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:53.978813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.104775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:54.112962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4c8ac4c3-4949-45f4-a40a-c7d868897bec tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1715 microversion: 2.1 time: 0.147619 Sep 28 15:45:54.113527 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 290/574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:53 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:54.221597 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:54.222212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:54.228742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.229224 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.229655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.230370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.230827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.231263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.314801 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] HTTP exception thrown: Cannot 'detach_volume' instance cbf736d9-c255-4f14-8763-4d61838297a8 while it is in vm_state rescued Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Request method failure captured: Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments/1d61f4d0-6d45-4792-a6d0-882fa9237f5d HTTP/1.1 Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs3ZKCm3aPR4SQ3jxI_H_A6V2-5NKmOzV6VGR_hY79N9a9rR6iU_UYFiwx99PuQizzzVQ08loaV8DD6nQ0bQj3UMJHIQiO0SvAZlbdaVXFFzXyRLZE3mHa4XGwobxC5aE0I-lPu2kyxRrXRtrZmyoF8pyUj8_Ss1aHoEA8DC3PtyA4 Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:45:54.316396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_824ddb9f6f344a2684cf31d08427306c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 36515ae6f91748babdcf6a9a72f59ed1 Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:45:54.318045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Cannot 'detach_volume' instance cbf736d9-c255-4f14-8763-4d61838297a8 while it is in vm_state rescued Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'server_id': 'cbf736d9-c255-4f14-8763-4d61838297a8', 'id': '1d61f4d0-6d45-4792-a6d0-882fa9237f5d'} Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbf736d9-c255-4f14-8763-4d61838297a8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:45:54.318736 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cbf736d9-c255-4f14-8763-4d61838297a8 while it is in vm_state rescued Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cbf736d9-c255-4f14-8763-4d61838297a8 while it is in vm_state rescued Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:45:54.320074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Returning 409 to user: Cannot 'detach_volume' instance cbf736d9-c255-4f14-8763-4d61838297a8 while it is in vm_state rescued {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:45:54.321025 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f12b91fe-f9bf-4a08-9f96-0826953833f4 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments/1d61f4d0-6d45-4792-a6d0-882fa9237f5d" status: 409 len: 152 microversion: 2.1 time: 0.100497 Sep 28 15:45:54.321025 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 285/575] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:45:54 2022] DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments/1d61f4d0-6d45-4792-a6d0-882fa9237f5d => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 15:45:54.326663 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:54.327190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:54.333056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.333535 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.334002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.334691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.335142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.335649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.402878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-088e8a31-d687-4da9-976a-57b3427cc6ce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "POST /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/action" status: 202 len: 0 microversion: 2.1 time: 0.079822 Sep 28 15:45:54.405554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 291/576] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:45:54 2022] POST /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:45:54.411710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:54.412324 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:54.420298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.420786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.421239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.421952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:54.422409 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:54.422872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:54.593376 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:54.602169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-75655092-904c-4628-b11b-30a0d2ad8997 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1723 microversion: 2.1 time: 0.194207 Sep 28 15:45:54.602719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 286/577] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:54 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:54.992126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:54.992720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:55.000130 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.000727 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.001230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.002096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.002662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.003154 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.029719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:45:55.106938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-46ea0ae7-bb0d-4c40-873c-18b36c8d708d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 204 len: 0 microversion: 2.1 time: 0.118883 Sep 28 15:45:55.107491 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 292/578] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:45:54 2022] DELETE /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:45:55.115682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:55.116288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:55.130648 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.131210 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.131617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.133015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.133465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.133920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.274850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:55.282592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7d5b5e99-c8f6-47a1-b66f-1c9852e149d5 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1514 microversion: 2.1 time: 0.170766 Sep 28 15:45:55.283162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 287/579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:55 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:45:55.625335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:55.626072 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:55.632099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.632583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.633020 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.633713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:55.634199 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:55.634630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:55.765100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:55.773359 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-edb7d9d0-67d0-4fb7-a6cc-a340e9f1d974 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1723 microversion: 2.1 time: 0.152232 Sep 28 15:45:55.773941 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 293/580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:55 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:56.304405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:56.305012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:56.311411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.311884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.312308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.312988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.313434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.313872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.440402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:56.448498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-04a2db01-f254-4bed-9c50-69a1cc03c442 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1514 microversion: 2.1 time: 0.147932 Sep 28 15:45:56.449095 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 288/581] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:56 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:56.796584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:56.797145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:56.803498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.804466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.804937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.805615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:56.806120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:56.806543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:56.953781 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:56.962095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ac301ae0-f266-4f58-9030-8b0648c69168 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1723 microversion: 2.1 time: 0.169431 Sep 28 15:45:56.962655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 294/582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:56 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:57.472687 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:57.473441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:57.480584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.481123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.481558 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.482274 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.482721 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.483138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.582775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:57.591196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-92985968-5ffc-47c7-bc59-06a69f520a8f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1472 microversion: 2.1 time: 0.122369 Sep 28 15:45:57.591795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 289/583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:57 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1472 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:57.622110 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-481bd5d4-033b-4a10-8d28-5bc0a7f9a7dd req-65d47432-e43c-42ea-bd48-609b44509172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692d866e-d4bb-492f-8b83-d51698930cc9", "name": "network-vif-deleted", "tag": "28f67cde-0b9a-4eaf-9fc3-3751023e941e"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:45:57.631515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-481bd5d4-033b-4a10-8d28-5bc0a7f9a7dd req-65d47432-e43c-42ea-bd48-609b44509172 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.631988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-481bd5d4-033b-4a10-8d28-5bc0a7f9a7dd req-65d47432-e43c-42ea-bd48-609b44509172 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.632411 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-481bd5d4-033b-4a10-8d28-5bc0a7f9a7dd req-65d47432-e43c-42ea-bd48-609b44509172 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.645113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-481bd5d4-033b-4a10-8d28-5bc0a7f9a7dd req-65d47432-e43c-42ea-bd48-609b44509172 service nova] Creating event network-vif-deleted:28f67cde-0b9a-4eaf-9fc3-3751023e941e for instance 692d866e-d4bb-492f-8b83-d51698930cc9 on hv-cinder-85931 Sep 28 15:45:57.650299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-481bd5d4-033b-4a10-8d28-5bc0a7f9a7dd req-65d47432-e43c-42ea-bd48-609b44509172 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Sep 28 15:45:57.650859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 295/584] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:45:57.984527 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:57.985062 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:57.991080 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.991560 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.991994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:57.992686 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:57.993139 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:57.993566 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.121625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:58.129803 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3d7ccbc3-9bcf-4570-9b84-746b1ed85727 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1723 microversion: 2.1 time: 0.149177 Sep 28 15:45:58.130477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 290/585] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:57 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:58.615658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:58.616947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:58.623316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:58.623816 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:58.624246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.624922 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:58.625367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:58.625796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:58.691094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:58.698903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-22619716-e906-4227-909c-b2d4d001a49d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1304 microversion: 2.1 time: 0.087957 Sep 28 15:45:58.699551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 296/586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:58 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:59.154179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:59.154782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:59.161063 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.161549 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.162001 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.162678 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.163788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.164236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.292484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:59.302089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3e79cc44-9eda-40b3-914e-be3cfe0e4dce tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1723 microversion: 2.1 time: 0.151699 Sep 28 15:45:59.302664 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 291/587] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:59 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:45:59.721530 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:45:59.722783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:45:59.729994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.730267 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.730699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.734167 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.734673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.735546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.769246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:45:59.769731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:45:59.770193 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:45:59.770639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lazy-loading 'fault' on Instance uuid 692d866e-d4bb-492f-8b83-d51698930cc9 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:45:59.812174 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:45:59.821505 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-89e58de9-b10d-4751-bce0-e2b54e590e30 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 200 len: 1309 microversion: 2.1 time: 0.103812 Sep 28 15:45:59.822182 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 297/588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:45:59 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:00.068431 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.069117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.071238 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=52 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:00.076949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.077429 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.077872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.078576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.079070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.079497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.107973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7fa03de2-cfd1-4b1c-b8d3-c17afc323658 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments/26060b00-00c9-498e-8879-6b6002a0d248" status: 200 len: 194 microversion: 2.20 time: 0.044502 Sep 28 15:46:00.108539 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 292/589] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments/26060b00-00c9-498e-8879-6b6002a0d248 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:46:00.175660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.176172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.182674 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.183148 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.183577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.184254 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.184712 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.185126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.265714 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lazy-loading 'services' on Instance uuid 44dffde6-94ba-408b-895a-eaaa80ad0b0f {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:00.329062 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.329814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.336409 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.337222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.337658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.338375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.338822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.339421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.352834 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0f256ee2-0fb5-4986-a76e-f4202c134f0e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments/26060b00-00c9-498e-8879-6b6002a0d248" status: 202 len: 0 microversion: 2.20 time: 0.181078 Sep 28 15:46:00.353424 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 298/590] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Sep 28 15:46:00 2022] DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments/26060b00-00c9-498e-8879-6b6002a0d248 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:46:00.362181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.364491 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.371723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.372263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.372645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.373349 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.373800 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.374285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.406050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f67b3aff-44dd-42bf-b0c8-fe344c67626a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047566 Sep 28 15:46:00.406931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 299/591] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 15:46:00.481792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:00.489842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-62189fdf-6d91-4963-84d1-3d7e6f1574cd tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1729 microversion: 2.1 time: 0.165047 Sep 28 15:46:00.490413 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 293/592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:00.512281 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.512771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.518788 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.519271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.519706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.520393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.520847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.521266 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.597428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b26e8ffe-5392-4935-9f72-f5f7a0e1520f tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088976 Sep 28 15:46:00.598063 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 300/593] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:00.846544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:00.847387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 692d866e-d4bb-492f-8b83-d51698930cc9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:00.854340 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.855050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.855652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.856488 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:00.856947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:00.857370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:00.871034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] HTTP exception thrown: Instance 692d866e-d4bb-492f-8b83-d51698930cc9 could not be found. Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Request method failure captured: Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 HTTP/1.1 Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGv6rBAfTwB_of2OxqLmuexB1bcHGxyidRRcH9YpAaMpq-Pe3qI0FGG-HePpJ3xo0gQxAu4SfxV82jw3YTJyVm-ma48IU0AyTB_5plX16Sy1o1c3bVLW6WQOCvFAz4qqVBj9BgYbD8bX1RtW-nufa6y44SHi8PaDDVDI0zWDEMZYuvU Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 6dcadaaec3664e8dace58c2479d8f534 Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1277778294 Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:46:00.872809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6dcadaaec3664e8dace58c2479d8f534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6dcadaaec3664e8dace58c2479d8f534"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6dcadaaec3664e8dace58c2479d8f534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6dcadaaec3664e8dace58c2479d8f534", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesSnapshotTestJSON-1277778294 Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 6dcadaaec3664e8dace58c2479d8f534 Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1277778294 Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesSnapshotTestJSON-1277778294-project Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: de27b2da998a4728b07fccfb12294e3d Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesSnapshotTestJSON-1277778294-project Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 692d866e-d4bb-492f-8b83-d51698930cc9 could not be found. Sep 28 15:46:00.874460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '692d866e-d4bb-492f-8b83-d51698930cc9'} Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692d866e-d4bb-492f-8b83-d51698930cc9 could not be found. Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:00.875615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692d866e-d4bb-492f-8b83-d51698930cc9 could not be found. Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692d866e-d4bb-492f-8b83-d51698930cc9 could not be found. Sep 28 15:46:00.877065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:00.878451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Returning 404 to user: Instance 692d866e-d4bb-492f-8b83-d51698930cc9 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:00.878451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-44efe267-c25f-4ed9-a837-f5e9cce62e56 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9" status: 404 len: 111 microversion: 2.1 time: 0.031712 Sep 28 15:46:00.878663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 294/594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:00 2022] GET /compute/v2.1/servers/692d866e-d4bb-492f-8b83-d51698930cc9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:46:01.419397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:01.421697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:01.428066 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.429089 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.429529 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.430261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.430715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.431139 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.463524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5b80cc8f-35c5-434b-aa36-8f5a95916466 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048639 Sep 28 15:46:01.464355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 301/595] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 15:46:01 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:01.500196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-b676fd8c-8b31-4612-8fa7-b3c373ab898a req-d797ddf6-5e68-4742-bc40-79f6ee4be1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf736d9-c255-4f14-8763-4d61838297a8", "tag": "df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:01.514525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b676fd8c-8b31-4612-8fa7-b3c373ab898a req-d797ddf6-5e68-4742-bc40-79f6ee4be1d9 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.514996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b676fd8c-8b31-4612-8fa7-b3c373ab898a req-d797ddf6-5e68-4742-bc40-79f6ee4be1d9 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.515587 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b676fd8c-8b31-4612-8fa7-b3c373ab898a req-d797ddf6-5e68-4742-bc40-79f6ee4be1d9 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.530719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-b676fd8c-8b31-4612-8fa7-b3c373ab898a req-d797ddf6-5e68-4742-bc40-79f6ee4be1d9 service nova] Creating event network-changed:df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b for instance cbf736d9-c255-4f14-8763-4d61838297a8 on hv-cinder-85931 Sep 28 15:46:01.536154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-b676fd8c-8b31-4612-8fa7-b3c373ab898a req-d797ddf6-5e68-4742-bc40-79f6ee4be1d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039415 Sep 28 15:46:01.537112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 295/596] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:01.549347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:01.549837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:01.556405 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.556879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.557305 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.558201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.558686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.559093 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.583558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:46:01.586469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:01.664598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-767a0812-f7ba-45a7-b06c-614d68a2174d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 204 len: 0 microversion: 2.20 time: 0.118743 Sep 28 15:46:01.665194 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 302/597] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 15:46:01 2022] DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 15:46:01.674257 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:01.675043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:01.682109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.682682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.683182 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.683983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:01.684486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:01.684973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:01.814956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:01.823143 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:01.824580 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:01.825733 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-db31fce0-1202-47dc-91fd-13a4b4b202f5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.155939 Sep 28 15:46:01.826306 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 296/598] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:01 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:02.851212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:02.851943 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:02.858414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:02.858896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:02.859332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:02.860019 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:02.860468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:02.860890 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:03.007466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:03.015435 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:03.016864 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:03.018055 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-adb3c1ab-9b73-4fb5-8832-3db9e8f8fd24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.171087 Sep 28 15:46:03.018757 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 303/599] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:02 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:03.554582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-35f8a0f7-891e-4a28-866e-a9144a2df807 req-d95d4d19-5ef4-4aeb-8256-86b0b96f643b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf736d9-c255-4f14-8763-4d61838297a8", "tag": "df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:03.564180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-35f8a0f7-891e-4a28-866e-a9144a2df807 req-d95d4d19-5ef4-4aeb-8256-86b0b96f643b service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:03.564644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-35f8a0f7-891e-4a28-866e-a9144a2df807 req-d95d4d19-5ef4-4aeb-8256-86b0b96f643b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:03.565063 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-35f8a0f7-891e-4a28-866e-a9144a2df807 req-d95d4d19-5ef4-4aeb-8256-86b0b96f643b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:03.575734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-35f8a0f7-891e-4a28-866e-a9144a2df807 req-d95d4d19-5ef4-4aeb-8256-86b0b96f643b service nova] Creating event network-changed:df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b for instance cbf736d9-c255-4f14-8763-4d61838297a8 on hv-cinder-85931 Sep 28 15:46:03.580444 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-35f8a0f7-891e-4a28-866e-a9144a2df807 req-d95d4d19-5ef4-4aeb-8256-86b0b96f643b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029482 Sep 28 15:46:03.581026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 297/600] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:04.044854 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:04.045484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:04.052139 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:04.052625 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:04.053060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:04.053756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:04.054294 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:04.054747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:04.188223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:04.197130 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:04.198594 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:04.199742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-40d062c8-cf60-40c6-bba0-3c20db0604f3 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.158870 Sep 28 15:46:04.200397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 304/601] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:04 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:05.226407 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:05.227105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:05.233227 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.233703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.234167 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.234850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:05.235303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:05.235725 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:05.364451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:05.373456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:05.377545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:05.378745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fa7de489-3c09-4d8a-aa16-0103050ef79b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.157884 Sep 28 15:46:05.391626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 298/602] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:05 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:06.404525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:06.405129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:06.411341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:06.411812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:06.412241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:06.413556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:06.414037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:06.414457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:06.542391 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:06.550612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:06.552248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:06.553533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-57e24e5e-50a2-4fb6-83df-7ba50cb575f9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.153138 Sep 28 15:46:06.554205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 305/603] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:06 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:07.578332 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:07.578922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:07.588610 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:07.589089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:07.589549 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:07.590310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:07.590755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:07.591170 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:07.716510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:07.724693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:07.726659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:07.727796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bf29cd3c-55f0-452a-aea5-93001d7173ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.153651 Sep 28 15:46:07.728331 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 299/604] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:07 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:08.662949 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1745404570", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "networks": [{"uuid": "db2750e0-a7a8-471c-8c9d-9a849d0d357e"}]}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:08.718393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] validate_networks() for [('db2750e0-a7a8-471c-8c9d-9a849d0d357e', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:46:08.753792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:08.754442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:08.761397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:08.761901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:08.762336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:08.763026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:08.763486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:08.763887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.448577 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:09.457256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:09.458763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:09.460097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b5b61aa3-d0c5-4022-a0c3-d7bac1086b0a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1724 microversion: 2.20 time: 0.710261 Sep 28 15:46:09.461140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 300/605] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:08 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1724 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:46:09.916933 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:46:09.917454 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:46:09.917821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:46:09.918287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:46:09.918699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:46:09.927749 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.928301 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.928588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.929407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:09.929869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:09.930307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:09.948418 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Getting quotas for project 6dcadaaec3664e8dace58c2479d8f534. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:09.952595 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Getting quotas for user de27b2da998a4728b07fccfb12294e3d and project 6dcadaaec3664e8dace58c2479d8f534. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:09.967006 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:46:09.969514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:46:10.021328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c46c86bd-7c7f-4e64-921c-4c1fe235d856 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362213 Sep 28 15:46:10.022175 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 306/606] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:46:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:46:10.033796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a9414baf-81e8-4b37-88c9-cb1058a8e3f6 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:10.034465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a9414baf-81e8-4b37-88c9-cb1058a8e3f6 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:10.155508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a9414baf-81e8-4b37-88c9-cb1058a8e3f6 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:10.163423 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a9414baf-81e8-4b37-88c9-cb1058a8e3f6 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1219 microversion: 2.1 time: 0.133208 Sep 28 15:46:10.178974 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 301/607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:10 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:10.469222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-e7ae9068-82fb-4a82-8f95-212bd01b20e2 req-e1f11151-089a-4aa2-8a78-aa025afcc4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44dffde6-94ba-408b-895a-eaaa80ad0b0f", "name": "network-vif-deleted", "tag": "0082d06d-1382-48f9-94de-259360a953c6"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:10.487038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:10.487843 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:10.495100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-e7ae9068-82fb-4a82-8f95-212bd01b20e2 req-e1f11151-089a-4aa2-8a78-aa025afcc4c8 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:10.495581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-e7ae9068-82fb-4a82-8f95-212bd01b20e2 req-e1f11151-089a-4aa2-8a78-aa025afcc4c8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:10.498523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:10.498948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:10.499772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:10.500790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:10.501969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-e7ae9068-82fb-4a82-8f95-212bd01b20e2 req-e1f11151-089a-4aa2-8a78-aa025afcc4c8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:10.503178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:10.504148 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:10.515777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-e7ae9068-82fb-4a82-8f95-212bd01b20e2 req-e1f11151-089a-4aa2-8a78-aa025afcc4c8 service nova] Creating event network-vif-deleted:0082d06d-1382-48f9-94de-259360a953c6 for instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f on hv-cinder-85931 Sep 28 15:46:10.520761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-e7ae9068-82fb-4a82-8f95-212bd01b20e2 req-e1f11151-089a-4aa2-8a78-aa025afcc4c8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056237 Sep 28 15:46:10.521687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 307/608] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:10.580036 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:10.589906 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:10.592921 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:10.594342 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-108f3fa6-192a-40a9-a60e-45ffbf034204 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 200 len: 1367 microversion: 2.20 time: 0.111551 Sep 28 15:46:10.595067 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 302/609] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:10 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:46:11.188865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:11.189560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:11.196647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:11.197356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:11.198589 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.199477 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:11.200535 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:11.201203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.302275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:11.313892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b8288edc-e198-4dc8-8e89-abe2e068dfdd tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1215 microversion: 2.1 time: 0.128851 Sep 28 15:46:11.314971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 308/610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:11 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:11.625538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:11.626188 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:11.633342 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:11.633824 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:11.634279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.634988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:11.635422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:11.635844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:11.649640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] HTTP exception thrown: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Request method failure captured: Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f HTTP/1.1 Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs38O9EBIK7hYyEBrEC6ee3MDpnaCDrQkQs5srjncsY9pFBe8pnP2T8AFgQK_iL10cAkdfFVnX_9uwJ4GMaBsYt3Kgd1RO6Mn6oOQycR3HTU_Dv1UcLU3DPKkQZoBsB1biHSUSGeSscljHL9fNuHjKLWjXA43StgHbfSpt7x7YbGSE Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:46:11.651604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_335ecfeb5c6a436e909618c1305593bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 298dfca23e004969a0c907e18c7237a4 Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:46:11.653286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '44dffde6-94ba-408b-895a-eaaa80ad0b0f'} Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:11.654248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:46:11.655697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:11.657620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Returning 404 to user: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:11.658912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0185eb7d-aede-4374-8428-dac3248d5ed0 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 404 len: 111 microversion: 2.20 time: 0.037934 Sep 28 15:46:11.659463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 303/611] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:11 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:46:11.668081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-83bd3934-a252-4dab-a17e-d05b84705dec tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '.version_select at 0x7f1154f93040>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:11.687835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-83bd3934-a252-4dab-a17e-d05b84705dec tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064814110" status: 204 len: 0 microversion: 2.20 time: 0.023724 Sep 28 15:46:11.688426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 309/612] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Sep 28 15:46:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064814110 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 15:46:12.339253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:12.339859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:12.346055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.346851 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.347508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.348032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-230901d0-6180-4bde-86b5-2abad523c6f2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'create', calling method: .version_select at 0x7f1154dbdee0>, body: {"keypair": {"name": "tempest-keypair-1192964095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG2d074qOUoiEBG67mcPh09PqRXV3izDkr2geHnm/QN7LKlDYv5OaBeeLckBCRCcrFXFf6Cue6A+iB4NPlNCkDsSljfS2MU+XqWjVDe35/dxwemx2gRfP6Fiqn6V0URMw=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:12.349134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:12.349759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:12.350292 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:12.375506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-230901d0-6180-4bde-86b5-2abad523c6f2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for project 335ecfeb5c6a436e909618c1305593bb. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:12.380004 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-230901d0-6180-4bde-86b5-2abad523c6f2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for user 298dfca23e004969a0c907e18c7237a4 and project 335ecfeb5c6a436e909618c1305593bb. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:12.403913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-230901d0-6180-4bde-86b5-2abad523c6f2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059757 Sep 28 15:46:12.404785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 310/613] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Sep 28 15:46:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 15:46:12.429087 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:12.437943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c817bfbd-ed4e-4795-9a50-043a9085f3f1 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1277 microversion: 2.1 time: 0.102481 Sep 28 15:46:12.439120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 304/614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:12 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:13.347871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-0fa3dcc8-765c-4cf4-992d-d8dc18168522 req-1e9d548d-260b-40e2-bfd7-006c515faccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9ec075-b31f-4706-83ff-ae91b89b9fb6", "tag": "c4b45be2-b46c-42b4-ad5b-290e97b5eb47"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:13.367501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0fa3dcc8-765c-4cf4-992d-d8dc18168522 req-1e9d548d-260b-40e2-bfd7-006c515faccd service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.369076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0fa3dcc8-765c-4cf4-992d-d8dc18168522 req-1e9d548d-260b-40e2-bfd7-006c515faccd service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.369617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0fa3dcc8-765c-4cf4-992d-d8dc18168522 req-1e9d548d-260b-40e2-bfd7-006c515faccd service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.381157 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-0fa3dcc8-765c-4cf4-992d-d8dc18168522 req-1e9d548d-260b-40e2-bfd7-006c515faccd service nova] Creating event network-changed:c4b45be2-b46c-42b4-ad5b-290e97b5eb47 for instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 on hv-cinder-85931 Sep 28 15:46:13.386924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-0fa3dcc8-765c-4cf4-992d-d8dc18168522 req-1e9d548d-260b-40e2-bfd7-006c515faccd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042963 Sep 28 15:46:13.387813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 311/615] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:13.462434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:13.463048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:13.469533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.470058 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.470500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.471199 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:13.471650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:13.472153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:13.476933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:13.683237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:13.695026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b0cefbe1-983f-484e-a401-cb5099ad4f6f tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.235789 Sep 28 15:46:13.711248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 305/616] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:13 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:13.807707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-537829822", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2beddede-7b14-4a1e-9c9b-0bc00eba3b72"}], "security_groups": [{"name": "tempest-securitygroup--1174445258"}], "key_name": "tempest-keypair-1192964095", "user_data": "}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:13.816263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:13.914009 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] validate_networks() for [('2beddede-7b14-4a1e-9c9b-0bc00eba3b72', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:46:14.274970 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:46:14.275476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:46:14.276062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:46:14.276589 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:46:14.277076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:46:14.286028 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:14.286519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:14.286954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.287690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:14.288145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:14.289074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.306251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for project 335ecfeb5c6a436e909618c1305593bb. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:14.310230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Getting quotas for user 298dfca23e004969a0c907e18c7237a4 and project 335ecfeb5c6a436e909618c1305593bb. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:14.321276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:46:14.323723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:46:14.370764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d128a044-0d51-488d-adf9-b8ea1a1b2a1c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.568326 Sep 28 15:46:14.371712 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 312/617] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Sep 28 15:46:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 15:46:14.382742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d14b8c46-f231-4f2c-b594-b36536d87b17 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:14.383345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d14b8c46-f231-4f2c-b594-b36536d87b17 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:14.435692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d14b8c46-f231-4f2c-b594-b36536d87b17 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:14.442976 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d14b8c46-f231-4f2c-b594-b36536d87b17 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:14.444390 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d14b8c46-f231-4f2c-b594-b36536d87b17 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:14.445476 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d14b8c46-f231-4f2c-b594-b36536d87b17 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1281 microversion: 2.20 time: 0.066765 Sep 28 15:46:14.446713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 306/618] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:14 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:14.717259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:14.717897 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:14.728184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:14.729117 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:14.729554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.730309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:14.730766 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:14.731220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:14.861836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:14.870701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bfa71eb9-e460-4cee-83b5-8c93e2e70136 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.157377 Sep 28 15:46:14.871274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 313/619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:14 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:15.469564 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:15.470276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:15.476833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:15.477316 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:15.477754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:15.478494 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:15.478946 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:15.479371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:15.544171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:15.552326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:15.554482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:15.555578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-42d4fd33-495b-4f74-b48b-d227b2d17f0f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1333 microversion: 2.20 time: 0.089881 Sep 28 15:46:15.556129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 307/620] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:15 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:15.902119 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:15.902723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:15.909161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:15.909695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:15.910195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:15.910882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:15.911328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:15.911743 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:16.131136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:16.139139 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-64ecb617-9324-459b-812e-51b37b3170da tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.240877 Sep 28 15:46:16.139906 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 314/621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:15 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:16.581505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:16.582772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:16.590989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:16.591842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:16.592387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:16.593466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:16.594360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:16.594964 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:16.810040 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:16.818729 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:16.820706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:16.821821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-03b88281-2594-4cc9-9510-f6265a293e39 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.245193 Sep 28 15:46:16.822388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 308/622] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:16 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:17.162214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:17.162833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:17.169560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:17.170109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:17.170543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:17.171235 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:17.171688 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:17.172126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:17.363377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:17.372212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-64207630-4bf9-4948-9d2c-dae6a37d7663 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.213742 Sep 28 15:46:17.372808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 315/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:17 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:17.402763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-d31d6417-61a9-4313-8781-5253c30a87bb req-5d72375e-d542-4a08-8c9d-7bfb8142c6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:17.413898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-d31d6417-61a9-4313-8781-5253c30a87bb req-5d72375e-d542-4a08-8c9d-7bfb8142c6fc service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:17.414379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-d31d6417-61a9-4313-8781-5253c30a87bb req-5d72375e-d542-4a08-8c9d-7bfb8142c6fc service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:17.414812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-d31d6417-61a9-4313-8781-5253c30a87bb req-5d72375e-d542-4a08-8c9d-7bfb8142c6fc service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:17.426070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-d31d6417-61a9-4313-8781-5253c30a87bb req-5d72375e-d542-4a08-8c9d-7bfb8142c6fc service nova] Creating event network-changed:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:46:17.431658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-d31d6417-61a9-4313-8781-5253c30a87bb req-5d72375e-d542-4a08-8c9d-7bfb8142c6fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032503 Sep 28 15:46:17.432277 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 309/624] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:46:17.847366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:17.847877 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:17.854543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:17.855020 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:17.855451 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:17.856143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:17.856596 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:17.857010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:17.981287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:17.989300 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:17.990769 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:17.991871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7988f9a1-22a0-4053-ab1f-ed208504fb2f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.148508 Sep 28 15:46:17.992423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 316/625] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:17 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:18.396276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:18.396963 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:18.403574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:18.404049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:18.404473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:18.405153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:18.405597 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:18.406048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:18.539882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:18.548029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9d45b16a-f9f2-4dac-ab2a-20c3c96bb237 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.156711 Sep 28 15:46:18.548525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 310/626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:18 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:18.601977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-02c6819c-c53f-4f2b-b41f-58fc90ee813b req-ad471f45-a232-4ea9-bd04-f7e8c8917a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ec075-b31f-4706-83ff-ae91b89b9fb6", "name": "network-vif-plugged", "status": "completed", "tag": "c4b45be2-b46c-42b4-ad5b-290e97b5eb47"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:18.612506 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-02c6819c-c53f-4f2b-b41f-58fc90ee813b req-ad471f45-a232-4ea9-bd04-f7e8c8917a72 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:18.612992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-02c6819c-c53f-4f2b-b41f-58fc90ee813b req-ad471f45-a232-4ea9-bd04-f7e8c8917a72 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:18.613426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-02c6819c-c53f-4f2b-b41f-58fc90ee813b req-ad471f45-a232-4ea9-bd04-f7e8c8917a72 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:18.628142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-02c6819c-c53f-4f2b-b41f-58fc90ee813b req-ad471f45-a232-4ea9-bd04-f7e8c8917a72 service nova] Creating event network-vif-plugged:c4b45be2-b46c-42b4-ad5b-290e97b5eb47 for instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 on hv-cinder-85931 Sep 28 15:46:18.633605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-02c6819c-c53f-4f2b-b41f-58fc90ee813b req-ad471f45-a232-4ea9-bd04-f7e8c8917a72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035694 Sep 28 15:46:18.634510 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 317/627] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:19.017215 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:19.018082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:19.024811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:19.025295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:19.025728 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:19.026498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:19.026947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:19.027364 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:19.261549 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:19.269689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:19.271159 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:19.272743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-399d8c38-f8b6-4412-90ca-3bb82d8f608b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.258980 Sep 28 15:46:19.273293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 311/628] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:19 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:19.571625 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:19.572317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:19.578401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:19.578883 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:19.579315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:19.580004 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:19.580491 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:19.580914 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:19.773591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:19.781229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7e2bad20-6e30-4b53-a9c5-2b5a5058253a tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.213893 Sep 28 15:46:19.781787 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 318/629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:19 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:20.297987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:20.298589 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:20.306683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:20.307157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:20.307588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:20.308271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:20.308716 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:20.309131 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:20.439798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:20.448230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:20.449656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:20.450846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-db9b8ad8-3008-42b7-986e-e6ce711ce877 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.156900 Sep 28 15:46:20.451598 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 312/630] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:20 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:20.807312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:20.807988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:20.814444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:20.814932 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:20.815368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:20.816064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:20.816523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:20.816946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:20.944470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:20.952769 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-61e50f02-37db-4973-b75e-f1fc6bfe1f84 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1319 microversion: 2.1 time: 0.152054 Sep 28 15:46:20.953338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 319/631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:20 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:21.476935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:21.477545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:21.483989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:21.484472 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:21.484908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:21.485600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:21.486077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:21.486507 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:21.614529 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:21.623389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:21.624818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:21.625940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-29456ef5-e742-4f88-beed-8ab9deea9d33 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.153353 Sep 28 15:46:21.626492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 313/632] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:21 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:21.976756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:21.977286 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:21.983753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:21.984226 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:21.984655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:21.985341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:21.985789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:21.986234 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:22.117957 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:22.125907 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c676209c-64c2-413a-926d-8b359df2a21e tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1508 microversion: 2.1 time: 0.153679 Sep 28 15:46:22.126509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 320/633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:21 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:22.148897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4bf4ce1-786f-48bd-8e44-967615b2fea3", "device": "/dev/sdb"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:22.151267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:22.157127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:22.157596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:22.158064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:22.158745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:22.159189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:22.159602 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:22.392809 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-637b5eca-ee9c-4bd3-8f1d-cc7401f168f7 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "POST /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248296 Sep 28 15:46:22.393397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 314/634] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:46:22 2022] POST /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:22.619400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-f00faf36-3d6a-46ea-9966-49979e5c7288 req-c0ce46af-d5f9-4e21-9d27-5215fe8243a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "name": "network-vif-plugged", "status": "completed", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:22.628788 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-f00faf36-3d6a-46ea-9966-49979e5c7288 req-c0ce46af-d5f9-4e21-9d27-5215fe8243a2 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:22.629241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-f00faf36-3d6a-46ea-9966-49979e5c7288 req-c0ce46af-d5f9-4e21-9d27-5215fe8243a2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:22.629667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-f00faf36-3d6a-46ea-9966-49979e5c7288 req-c0ce46af-d5f9-4e21-9d27-5215fe8243a2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:22.641464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-f00faf36-3d6a-46ea-9966-49979e5c7288 req-c0ce46af-d5f9-4e21-9d27-5215fe8243a2 service nova] Creating event network-vif-plugged:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:46:22.646458 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-f00faf36-3d6a-46ea-9966-49979e5c7288 req-c0ce46af-d5f9-4e21-9d27-5215fe8243a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 Sep 28 15:46:22.647245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 321/635] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:22.652464 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:22.653226 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:22.659686 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:22.660174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:22.660603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:22.662396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:22.662861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:22.664817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:22.808037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:22.816049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:22.817483 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:22.818639 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b1a0e653-4cb5-4f5a-992d-083a57bd9ac2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.171735 Sep 28 15:46:22.819560 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 315/636] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:22 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:23.844895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:23.845590 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:23.851803 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:23.852288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:23.852719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:23.853404 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:23.853875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:23.854302 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:23.983036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:23.991037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:23.992474 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:23.994359 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c33b5d53-2340-4634-b93b-87529bb268e6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1407 microversion: 2.20 time: 0.154192 Sep 28 15:46:23.994912 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 322/637] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:23 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:25.019224 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:25.019900 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:25.022279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=4 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:25.028090 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:25.028562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:25.028987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:25.029703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:25.030182 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:25.030596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:25.169210 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:25.177290 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:25.178742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:25.179878 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7c64ded2-8aa9-4084-8364-47f35a165196 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1599 microversion: 2.20 time: 0.164614 Sep 28 15:46:25.180416 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 316/638] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:46:25 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:46:25.203996 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:25.204549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:25.206666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=4 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:25.207331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=16 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:25.214484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:25.214971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:25.215407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:25.216103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:25.216555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:25.216985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:25.292553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0f0a86d2-99d6-4c9c-b8d7-4604056e6689 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092390 Sep 28 15:46:25.293158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 323/639] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Sep 28 15:46:25 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:46:25.889077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:25.891421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:25.897935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:25.898415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:25.898850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:25.899541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:25.899990 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:25.900412 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:25.931327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4f915f7f-3c34-4ea7-ad06-37a60681dc32 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046083 Sep 28 15:46:25.931893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 317/640] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:25 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:46:25.998524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:25.999035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:26.005553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:26.006083 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:26.006523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:26.007230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:26.007685 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:26.008111 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:26.013500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:26.043842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:46:26.137334 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-83d5e6cc-f595-410d-be8e-2702c8ac2985 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 204 len: 0 microversion: 2.1 time: 0.142498 Sep 28 15:46:26.140085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 324/641] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:46:25 2022] DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:46:26.149840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:26.151078 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:26.158735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:26.159323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:26.159943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:26.160834 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:26.161333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:26.161967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:26.411048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:26.420380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ccbe5949-91ce-4215-af23-52c880815afa tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1673 microversion: 2.1 time: 0.277091 Sep 28 15:46:26.420949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 318/642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:26 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1673 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:26.569622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-51030215-8f42-4475-b726-94670f0d9de2 req-6f07598a-ad8c-4f89-ba2f-7da52c988250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:26.580068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-51030215-8f42-4475-b726-94670f0d9de2 req-6f07598a-ad8c-4f89-ba2f-7da52c988250 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:26.580549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-51030215-8f42-4475-b726-94670f0d9de2 req-6f07598a-ad8c-4f89-ba2f-7da52c988250 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:26.580970 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-51030215-8f42-4475-b726-94670f0d9de2 req-6f07598a-ad8c-4f89-ba2f-7da52c988250 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:26.591788 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-51030215-8f42-4475-b726-94670f0d9de2 req-6f07598a-ad8c-4f89-ba2f-7da52c988250 service nova] Creating event network-changed:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:46:26.596565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-51030215-8f42-4475-b726-94670f0d9de2 req-6f07598a-ad8c-4f89-ba2f-7da52c988250 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030997 Sep 28 15:46:26.597147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 325/643] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:27.445452 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:27.446990 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:27.454383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:27.454953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:27.455461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:27.456245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:27.456696 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:27.457122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:27.699760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:27.707545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e75ed940-4033-4a03-aab5-16eacf6b40a1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1673 microversion: 2.1 time: 0.266987 Sep 28 15:46:27.708101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 319/644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:27 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1673 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:28.732245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:28.732936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:28.739118 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:28.739598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:28.740038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:28.740732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:28.741186 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:28.741609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:28.943309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:28.951143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b02e04fb-9f82-4a76-b47c-abe8c64fff19 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1673 microversion: 2.1 time: 0.223638 Sep 28 15:46:28.951714 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 326/645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:28 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:29.974710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:29.976170 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:29.982755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:29.983241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:29.983673 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:29.984372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:29.984823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:29.985252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:30.222091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:30.229606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-768764ad-1e89-4e9a-a5ac-2614496d0b7c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1673 microversion: 2.1 time: 0.259431 Sep 28 15:46:30.230206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 320/646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:29 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:30.443902 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-57ce6ce4-eab2-4dcc-b4b3-4b7fc0e93abb req-90af513d-b2c9-4bec-b09c-e55951f3ce67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac91576-c5d2-418a-a1c5-af43fccf4e46", "name": "network-vif-deleted", "tag": "9e5dd716-5edb-44f2-a44f-e25367a21810"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:30.455573 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-57ce6ce4-eab2-4dcc-b4b3-4b7fc0e93abb req-90af513d-b2c9-4bec-b09c-e55951f3ce67 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:30.456185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-57ce6ce4-eab2-4dcc-b4b3-4b7fc0e93abb req-90af513d-b2c9-4bec-b09c-e55951f3ce67 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:30.456692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-57ce6ce4-eab2-4dcc-b4b3-4b7fc0e93abb req-90af513d-b2c9-4bec-b09c-e55951f3ce67 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:30.469152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-57ce6ce4-eab2-4dcc-b4b3-4b7fc0e93abb req-90af513d-b2c9-4bec-b09c-e55951f3ce67 service nova] Creating event network-vif-deleted:9e5dd716-5edb-44f2-a44f-e25367a21810 for instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 on hv-cinder-85931 Sep 28 15:46:30.474428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-57ce6ce4-eab2-4dcc-b4b3-4b7fc0e93abb req-90af513d-b2c9-4bec-b09c-e55951f3ce67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034378 Sep 28 15:46:30.479079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 327/647] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:31.254387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:31.255164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:31.257354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=62 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:31.263415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:31.263901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:31.264340 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:31.265037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:31.265518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:31.266077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:31.330074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:31.338818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d81ca9d1-a8cc-445e-ade3-9209d4de34d2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1322 microversion: 2.1 time: 0.088241 Sep 28 15:46:31.339390 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 321/648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:31 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:31.588195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:31.588689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:31.594919 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:31.595391 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:31.595821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:31.596544 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:31.596940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:31.597354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:31.622679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f7409646-816b-4073-aa8f-072127278ca4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/ips" status: 200 len: 151 microversion: 2.1 time: 0.039415 Sep 28 15:46:31.623257 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 328/649] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:46:31 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:32.361754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:32.362397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:32.369192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:32.369670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:32.370134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:32.370822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:32.371272 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:32.371693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:32.375614 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:32.435468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:32.443150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6c864c51-0502-4147-b060-03e87239e30c tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1322 microversion: 2.1 time: 0.085381 Sep 28 15:46:32.443706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 322/650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:32 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1322 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:33.465175 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:33.465722 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:33.472089 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:33.472563 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:33.472997 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:33.473676 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:33.474147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:33.474568 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:33.505550 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:33.506072 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:33.506498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:33.506932 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lazy-loading 'fault' on Instance uuid 8ac91576-c5d2-418a-a1c5-af43fccf4e46 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:33.552551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:33.560747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-52d12aba-1a16-4763-b1a3-5679e8fbf909 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 200 len: 1327 microversion: 2.1 time: 0.099535 Sep 28 15:46:33.561504 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 329/651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:33 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:34.008061 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b4138f-f791-4e92-ab25-cf6464dfeec9"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:34.010436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:34.016734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:34.017217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:34.017646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:34.018368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:34.018820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:34.019241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:34.276490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-facdb2d1-60dc-4323-80f5-1ecc03046591 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272172 Sep 28 15:46:34.277451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 323/652] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:46:34 2022] POST /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:34.585472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:34.586113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:34.592356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:34.592833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:34.593265 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:34.593971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:34.594432 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:34.594850 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:34.607735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] HTTP exception thrown: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Request method failure captured: Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 HTTP/1.1 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs1ztkHy0woD6YVEjLMrW9Rl67UFVCCkdSv3Wds7zKSiwCrd_uOfAwktGv6I7u5Os7nv-AYjAfOynwxrEHbg180lJiHhV2ZNZftlspqiKE-NgXssFB46KjBvsRjmSEt84xW_uLB7bEXXl3rCwHVuJ2IXNDlcNp8LmEM2THxoDhaj-4 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:46:34.609342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62692d2b160040879aecaf4d44ad19b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 634c0af05b334b488f2fa358e574172b Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:46:34.610992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '8ac91576-c5d2-418a-a1c5-af43fccf4e46'} Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:34.611785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:46:34.612962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:34.614059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Returning 404 to user: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:34.614059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3906071f-48a5-45dc-bc58-6d925ba06b38 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 404 len: 111 microversion: 2.1 time: 0.029184 Sep 28 15:46:34.614059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 330/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:34 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:46:34.621037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bd568fd6-d559-410a-b38b-ec256d46426b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '.version_select at 0x7f1154e26670>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:34.640599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bd568fd6-d559-410a-b38b-ec256d46426b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628534242" status: 202 len: 0 microversion: 2.1 time: 0.024775 Sep 28 15:46:34.641151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 324/654] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 15:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628534242 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:46:35.258159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-703b1869-0b00-4589-91fd-6d38be4994df tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: .version_select at 0x7f1154e14ca0>, body: {"keypair": {"name": "tempest-keypair-527285763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBPAtIrMZ4n69PADGC+sGA3S641YgsUg9mu9NjOJrRa0ZTLZEOOyehVVIBEZmC/NfZDYVOaCxrBpjZEwDdnqgSz05cSnwm3FAvUBmL+N8xZDePxoFX/yb2evktdcRT3ig=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:35.273764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-703b1869-0b00-4589-91fd-6d38be4994df tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for project 62692d2b160040879aecaf4d44ad19b3. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:35.277676 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-703b1869-0b00-4589-91fd-6d38be4994df tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for user 634c0af05b334b488f2fa358e574172b and project 62692d2b160040879aecaf4d44ad19b3. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:35.300374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-703b1869-0b00-4589-91fd-6d38be4994df tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046086 Sep 28 15:46:35.300977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 331/655] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:46:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:36.545901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1344079142", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85a0d787-d04b-4ff1-9585-ae17b62d54da"}], "security_groups": [{"name": "tempest-securitygroup--1153410208"}], "key_name": "tempest-keypair-527285763", "user_data": "}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:36.649883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] validate_networks() for [('85a0d787-d04b-4ff1-9585-ae17b62d54da', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:46:37.011355 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:46:37.011775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:46:37.012243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:46:37.012645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:46:37.013052 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:46:37.021792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:37.022304 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:37.022732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:37.023485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:37.023933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:37.024356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:37.040990 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for project 62692d2b160040879aecaf4d44ad19b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:37.045010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Getting quotas for user 634c0af05b334b488f2fa358e574172b and project 62692d2b160040879aecaf4d44ad19b3. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:37.056284 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:46:37.058650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:46:37.106390 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b88f0224-e082-481c-a3ce-f475d60ed060 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565330 Sep 28 15:46:37.107031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 325/656] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:46:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 15:46:37.119878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b7ef0123-30f7-467d-96ca-d31c1eaabea8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:37.120488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b7ef0123-30f7-467d-96ca-d31c1eaabea8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:37.176163 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b7ef0123-30f7-467d-96ca-d31c1eaabea8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:37.184136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b7ef0123-30f7-467d-96ca-d31c1eaabea8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1237 microversion: 2.1 time: 0.069733 Sep 28 15:46:37.184703 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 332/657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:37 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:38.207593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:38.208164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:38.214971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:38.215443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:38.215881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:38.216548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:38.216992 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:38.217408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:38.282940 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:38.290792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-97dbf31c-79d2-432c-9661-115373400392 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1289 microversion: 2.1 time: 0.087397 Sep 28 15:46:38.291699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 326/658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:38 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:39.316278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:39.317583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:39.325563 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:39.326644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:39.327291 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:39.328165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:39.328746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:39.329268 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:39.575639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:39.585531 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1cfeb039-bb8e-4196-8a3f-2a57c7624fdd tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.274511 Sep 28 15:46:39.596316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 333/659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:39 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:39.965665 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-01fc8c01-26c2-4924-be15-2d865fa00120 req-2e50886f-05c5-4e90-befc-61d49952f88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa320caa-d879-4630-95ed-d94d1aba1eba", "tag": "9f8defde-2966-4708-857b-a6dddf82eddc"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:39.977915 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-01fc8c01-26c2-4924-be15-2d865fa00120 req-2e50886f-05c5-4e90-befc-61d49952f88b service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:39.978395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-01fc8c01-26c2-4924-be15-2d865fa00120 req-2e50886f-05c5-4e90-befc-61d49952f88b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:39.978826 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-01fc8c01-26c2-4924-be15-2d865fa00120 req-2e50886f-05c5-4e90-befc-61d49952f88b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:39.997034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-01fc8c01-26c2-4924-be15-2d865fa00120 req-2e50886f-05c5-4e90-befc-61d49952f88b service nova] Creating event network-changed:9f8defde-2966-4708-857b-a6dddf82eddc for instance aa320caa-d879-4630-95ed-d94d1aba1eba on hv-cinder-85931 Sep 28 15:46:40.001759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-01fc8c01-26c2-4924-be15-2d865fa00120 req-2e50886f-05c5-4e90-befc-61d49952f88b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041249 Sep 28 15:46:40.002521 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 327/660] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:40.621221 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:40.622088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:40.628345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:40.628827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:40.629263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:40.629987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:40.630443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:40.630866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:40.765520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:40.773552 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a7a3ed68-0879-41da-8aa3-2ed13ac789a3 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.157042 Sep 28 15:46:40.790012 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 334/661] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:40 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:41.827769 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:41.828373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:41.835088 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:41.836228 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:41.836664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:41.837371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:41.837991 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:41.838340 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:41.890006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:41.890713 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:41.896850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:41.897269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:41.897691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:41.899087 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:41.899409 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:41.899824 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:41.925104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lazy-loading 'services' on Instance uuid 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:42.000708 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-89e64af9-e71a-4363-81ea-c98ab08763c0 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6/os-volume_attachments/c4bf4ce1-786f-48bd-8e44-967615b2fea3" status: 202 len: 0 microversion: 2.1 time: 0.178206 Sep 28 15:46:42.001301 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 335/662] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:46:41 2022] DELETE /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6/os-volume_attachments/c4bf4ce1-786f-48bd-8e44-967615b2fea3 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:46:42.120944 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:42.130357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-92136e46-4b0d-4da4-8f4d-7ab3ea2a7143 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.337557 Sep 28 15:46:42.130954 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 328/663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:41 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:43.154806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:43.155334 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:43.162093 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:43.162575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:43.163010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:43.163699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:43.164155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:43.164607 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:43.296758 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:43.303934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-caf5a2ba-daa4-4f39-9ed6-c6504b98c908 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.153725 Sep 28 15:46:43.304484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 336/664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:43 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:44.060812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b4138f-f791-4e92-ab25-cf6464dfeec9"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:44.063239 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:44.070650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.071153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.071595 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.072297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.072754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.073177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.153653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Invalid volume: volume 59b4138f-f791-4e92-ab25-cf6464dfeec9 is already attached to instances: a90517e8-f8ed-480c-9005-afe1f77323e8 Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: POST /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments HTTP/1.1 Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 74 Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:46:44.155433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {"volumeAttachment": {"volumeId": "59b4138f-f791-4e92-ab25-cf6464dfeec9"}} Sep 28 15:46:44.157020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Invalid volume: volume 59b4138f-f791-4e92-ab25-cf6464dfeec9 is already attached to instances: a90517e8-f8ed-480c-9005-afe1f77323e8 Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'server_id': 'a90517e8-f8ed-480c-9005-afe1f77323e8', 'body': {'volumeAttachment': {'volumeId': '59b4138f-f791-4e92-ab25-cf6464dfeec9'}}} Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 59b4138f-f791-4e92-ab25-cf6464dfeec9 is already attached to instances: a90517e8-f8ed-480c-9005-afe1f77323e8 Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:44.158120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 59b4138f-f791-4e92-ab25-cf6464dfeec9 is already attached to instances: a90517e8-f8ed-480c-9005-afe1f77323e8 Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:44.159504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 59b4138f-f791-4e92-ab25-cf6464dfeec9 is already attached to instances: a90517e8-f8ed-480c-9005-afe1f77323e8 Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 400 to user: Invalid volume: volume 59b4138f-f791-4e92-ab25-cf6464dfeec9 is already attached to instances: a90517e8-f8ed-480c-9005-afe1f77323e8 {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-951fc0e0-0d4d-4b02-8dd6-6cb56c8c7770 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100686 Sep 28 15:46:44.160945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 329/665] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:46:44 2022] POST /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:46:44.224002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:44.224485 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:44.227948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:44.233205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.233679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.234169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.234852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.235297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.235715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.322486 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lazy-loading 'services' on Instance uuid a90517e8-f8ed-480c-9005-afe1f77323e8 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:44.326588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:44.327207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:44.333832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.334560 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.334997 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.336369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.336840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.337270 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.399852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b78cd743-8ede-436f-ba20-298de20e2c9c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments/59b4138f-f791-4e92-ab25-cf6464dfeec9" status: 202 len: 0 microversion: 2.1 time: 0.179459 Sep 28 15:46:44.400835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 337/666] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:46:44 2022] DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments/59b4138f-f791-4e92-ab25-cf6464dfeec9 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:46:44.410034 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:44.412447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:44.419301 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.419858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.420352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.421297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.421752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.422197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.457955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b8d9229a-57f5-4c52-923e-8a06173c71b0 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052533 Sep 28 15:46:44.458889 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 338/667] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:44 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:46:44.505724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:44.513806 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4118ed7f-f5a8-463f-83a4-894cabdfcd85 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.191034 Sep 28 15:46:44.514596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 330/668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:44 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:44.590656 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-9589dc26-b145-4655-9bb5-b4477590840e req-cd493c63-8d6d-4102-8ada-a941e90ac9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa320caa-d879-4630-95ed-d94d1aba1eba", "name": "network-vif-plugged", "status": "completed", "tag": "9f8defde-2966-4708-857b-a6dddf82eddc"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:44.600074 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-9589dc26-b145-4655-9bb5-b4477590840e req-cd493c63-8d6d-4102-8ada-a941e90ac9c2 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:44.600554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-9589dc26-b145-4655-9bb5-b4477590840e req-cd493c63-8d6d-4102-8ada-a941e90ac9c2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:44.600981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-9589dc26-b145-4655-9bb5-b4477590840e req-cd493c63-8d6d-4102-8ada-a941e90ac9c2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:44.612799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-9589dc26-b145-4655-9bb5-b4477590840e req-cd493c63-8d6d-4102-8ada-a941e90ac9c2 service nova] Creating event network-vif-plugged:9f8defde-2966-4708-857b-a6dddf82eddc for instance aa320caa-d879-4630-95ed-d94d1aba1eba on hv-cinder-85931 Sep 28 15:46:44.618609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-9589dc26-b145-4655-9bb5-b4477590840e req-cd493c63-8d6d-4102-8ada-a941e90ac9c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030474 Sep 28 15:46:44.619211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 339/669] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:46:45.251612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:45.252194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:45.258887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.259365 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.259791 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.260495 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.260984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.261332 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.286624 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:46:45.358529 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b449fbb2-28aa-4318-8d99-52e0330d7998 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 204 len: 0 microversion: 2.1 time: 0.110282 Sep 28 15:46:45.359045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 331/670] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:46:45 2022] DELETE /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:46:45.369261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:45.370013 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:45.376124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.376602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.377036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.377721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.378231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.378652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.471670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:45.474419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:45.481045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.481594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.482171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.482926 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.483441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.483924 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.511658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:45.514252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-70a11021-c053-4762-b93b-f01141127cdb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Sep 28 15:46:45.514812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 332/671] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:45 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:46:45.519904 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6fe9e054-e0bb-4759-99a7-db24ad18b9ed tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1514 microversion: 2.1 time: 0.156154 Sep 28 15:46:45.520467 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 340/672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:45 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:45.537291 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:45.537921 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:45.544383 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.544863 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.545301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.546020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:45.546477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:45.546902 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:45.675608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:45.683912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-63fdaa95-f59a-4187-9a8b-df7281fb1edc tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.150284 Sep 28 15:46:45.684480 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 333/673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:45 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:46.526991 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:46.529154 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:46.536128 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:46.536610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:46.537073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:46.537780 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:46.538265 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:46.538689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:46.542760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:46.543376 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:46.549497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:46.549925 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:46.550367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:46.551064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:46.551519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:46.551948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:46.569239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-302f9b8a-9bab-488e-b937-9601d2560a84 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Sep 28 15:46:46.569802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 341/674] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:46 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:46.677289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:46.685379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b2fc816a-962a-4749-8b0b-d47d4324cb01 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1514 microversion: 2.1 time: 0.146448 Sep 28 15:46:46.685967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 334/675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:46 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:46.707271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:46.707880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:46.714952 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:46.715442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:46.715873 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:46.716569 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:46.717015 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:46.717436 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:46.736584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:46.850916 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:46.861488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a5469089-f45c-4314-8a9a-c465671622cb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.157991 Sep 28 15:46:46.862098 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 342/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:46 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:47.582438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:47.584697 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:47.587393 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:47.588051 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:47.594018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.594498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.594937 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.595627 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.596079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.596496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.624466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b80d2136-03db-4752-b586-d9bf657eeb12 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045981 Sep 28 15:46:47.625065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 335/677] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:47 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:46:47.686953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:47.687438 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:47.689260 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:47.695073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.695554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.696518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.697263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.697667 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.698117 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.708719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:47.709318 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:47.715772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.716248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.716674 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.717355 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.717798 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.718241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.725036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:46:47.802005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a8ac7b22-8570-4d86-8d7e-81c9de493153 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 204 len: 0 microversion: 2.1 time: 0.118429 Sep 28 15:46:47.802535 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 343/678] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:46:47 2022] DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:46:47.810800 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:47.811495 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:47.817210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.817697 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.818165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.818859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.819311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.819733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.851485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:47.860659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-99245acc-a0df-4d8e-a1b0-d2389e0e0068 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1514 microversion: 2.1 time: 0.155874 Sep 28 15:46:47.861245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 336/679] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:47 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:47.885470 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:47.886102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:47.891993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.892478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.892969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.893663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:47.894179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:47.894598 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:47.978593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:47.986614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d43255e8-d5c8-4f1b-9c8d-f2fc11623b63 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1683 microversion: 2.1 time: 0.179708 Sep 28 15:46:47.987339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 344/680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:47 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:48.043310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:48.050812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7ab6c2e2-01a4-44bc-9eb5-851bed942f13 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1363 microversion: 2.1 time: 0.170119 Sep 28 15:46:48.051423 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 337/681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:47 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:48.484399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-10c8d0e9-c005-4b4c-aee2-9c2c610fa2fa req-ca40f9b7-83ea-463f-a578-aeb8c0841d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9ec075-b31f-4706-83ff-ae91b89b9fb6", "name": "network-vif-deleted", "tag": "c4b45be2-b46c-42b4-ad5b-290e97b5eb47"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:48.494709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-10c8d0e9-c005-4b4c-aee2-9c2c610fa2fa req-ca40f9b7-83ea-463f-a578-aeb8c0841d84 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:48.495188 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-10c8d0e9-c005-4b4c-aee2-9c2c610fa2fa req-ca40f9b7-83ea-463f-a578-aeb8c0841d84 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:48.495621 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-10c8d0e9-c005-4b4c-aee2-9c2c610fa2fa req-ca40f9b7-83ea-463f-a578-aeb8c0841d84 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:48.506262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-10c8d0e9-c005-4b4c-aee2-9c2c610fa2fa req-ca40f9b7-83ea-463f-a578-aeb8c0841d84 service nova] Creating event network-vif-deleted:c4b45be2-b46c-42b4-ad5b-290e97b5eb47 for instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 on hv-cinder-85931 Sep 28 15:46:48.511047 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-10c8d0e9-c005-4b4c-aee2-9c2c610fa2fa req-ca40f9b7-83ea-463f-a578-aeb8c0841d84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030264 Sep 28 15:46:48.511551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 345/682] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:48.890792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:48.891419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:48.897774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:48.898288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:48.898722 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:48.899908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:48.900359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:48.900780 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:48.904684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:48.952185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:48.952768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:48.958992 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:48.959478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:48.959914 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:48.960607 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:48.961064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:48.962045 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:48.969631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:48.977717 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d30660e6-7789-4df0-896d-dbca48fa80af tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1472 microversion: 2.1 time: 0.090182 Sep 28 15:46:48.978312 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 338/683] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:48 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:49.010696 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:49.011303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:49.017146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.017628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.018107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.018816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.019255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.019680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.042830 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'services' on Instance uuid cbf736d9-c255-4f14-8763-4d61838297a8 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:49.115128 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5728876b-1f21-4d73-ae1c-4d0c9c5813f5 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments/1d61f4d0-6d45-4792-a6d0-882fa9237f5d" status: 202 len: 0 microversion: 2.1 time: 0.167504 Sep 28 15:46:49.115736 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 346/684] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:46:48 2022] DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments/1d61f4d0-6d45-4792-a6d0-882fa9237f5d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:46:49.121288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:49.122057 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:49.128569 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.129050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.129483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.130192 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.130639 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.131086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.151454 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:49.159152 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a1ab7a83-8dbf-43c9-a0bc-efb492fade4e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1683 microversion: 2.1 time: 0.152167 Sep 28 15:46:49.159717 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 339/685] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:49 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:49.164186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:49.166421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:49.172197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.172679 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.173116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.173821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.174297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.174720 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.205688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8c278a72-de73-4b61-9457-c649fa832b57 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Sep 28 15:46:49.206282 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 340/686] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:49 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:49.265656 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:49.273761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7bbbf092-2552-42ba-a265-8c92a628bb9b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1549 microversion: 2.1 time: 0.156773 Sep 28 15:46:49.275709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 347/687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:49 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:49.296481 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:49.296840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:49.302983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.303471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.303912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.304611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:49.305113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:49.305568 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:49.384672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bec537d9-9004-42ea-ab43-a817b73b4be2 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092159 Sep 28 15:46:49.385266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 341/688] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:46:49 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:50.000939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:50.001600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:50.008292 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.008994 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.009432 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.010206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.010661 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.011090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.042124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.042607 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.043038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.043481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lazy-loading 'fault' on Instance uuid 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:50.090654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de27b2da998a4728b07fccfb12294e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcadaaec3664e8dace58c2479d8f534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:50.098246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-19e76b68-c2af-402f-9a9c-e7230ef6304d tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 200 len: 1309 microversion: 2.1 time: 0.101243 Sep 28 15:46:50.098815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 348/689] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:49 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:50.183327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:50.184901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:50.191958 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.192315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.192735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.193419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.194915 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.195715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.221802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:50.226367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:50.236190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.236977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.237422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.238170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.238629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.239399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.272442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-35d83d6f-e73a-4db8-9114-375abf9859de tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056893 Sep 28 15:46:50.273515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 349/690] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:50 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:50.486840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:50.496951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-87840bde-196b-4b4e-b1cc-ff6dc08801b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1683 microversion: 2.1 time: 0.317819 Sep 28 15:46:50.497761 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 342/691] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:50 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1683 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:50.581241 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-546ac3f3-bdc8-42c8-8e16-71f529e4dddf req-7ebbeb69-125d-4cd2-868a-94c58a4ae789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa320caa-d879-4630-95ed-d94d1aba1eba", "tag": "9f8defde-2966-4708-857b-a6dddf82eddc"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:50.591638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-546ac3f3-bdc8-42c8-8e16-71f529e4dddf req-7ebbeb69-125d-4cd2-868a-94c58a4ae789 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:50.592393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-546ac3f3-bdc8-42c8-8e16-71f529e4dddf req-7ebbeb69-125d-4cd2-868a-94c58a4ae789 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:50.592825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-546ac3f3-bdc8-42c8-8e16-71f529e4dddf req-7ebbeb69-125d-4cd2-868a-94c58a4ae789 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:50.604130 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-546ac3f3-bdc8-42c8-8e16-71f529e4dddf req-7ebbeb69-125d-4cd2-868a-94c58a4ae789 service nova] Creating event network-changed:9f8defde-2966-4708-857b-a6dddf82eddc for instance aa320caa-d879-4630-95ed-d94d1aba1eba on hv-cinder-85931 Sep 28 15:46:50.608964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-546ac3f3-bdc8-42c8-8e16-71f529e4dddf req-7ebbeb69-125d-4cd2-868a-94c58a4ae789 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031278 Sep 28 15:46:50.609785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 350/692] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:51.122567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:51.123170 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] [instance: 2c9ec075-b31f-4706-83ff-ae91b89b9fb6] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:51.130096 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.130581 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.131008 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.131708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.132154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.132572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.147730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] HTTP exception thrown: Instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 could not be found. Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Request method failure captured: Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 HTTP/1.1 Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGv6rBAfTwB_of2OxqLmuexB1bcHGxyidRRcH9YpAaMpq-Pe3qI0FGG-HePpJ3xo0gQxAu4SfxV82jw3YTJyVm-ma48IU0AyTB_5plX16Sy1o1c3bVLW6WQOCvFAz4qqVBj9BgYbD8bX1RtW-nufa6y44SHi8PaDDVDI0zWDEMZYuvU Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 6dcadaaec3664e8dace58c2479d8f534 Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1277778294 Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:46:51.149387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6dcadaaec3664e8dace58c2479d8f534"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6dcadaaec3664e8dace58c2479d8f534"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6dcadaaec3664e8dace58c2479d8f534"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6dcadaaec3664e8dace58c2479d8f534", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesSnapshotTestJSON-1277778294 Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 6dcadaaec3664e8dace58c2479d8f534 Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1277778294 Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesSnapshotTestJSON-1277778294-project Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: de27b2da998a4728b07fccfb12294e3d Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesSnapshotTestJSON-1277778294-project Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 could not be found. Sep 28 15:46:51.150882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '2c9ec075-b31f-4706-83ff-ae91b89b9fb6'} Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 could not be found. Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:51.151683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 could not be found. Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 could not be found. Sep 28 15:46:51.152938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:46:51.154084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] Returning 404 to user: Instance 2c9ec075-b31f-4706-83ff-ae91b89b9fb6 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:51.154084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9efe870f-1019-448a-89d0-690a762be0a4 tempest-VolumesSnapshotTestJSON-1277778294 tempest-VolumesSnapshotTestJSON-1277778294-project] 10.222.0.52 "GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6" status: 404 len: 111 microversion: 2.1 time: 0.032116 Sep 28 15:46:51.154084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 343/693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:51 2022] GET /compute/v2.1/servers/2c9ec075-b31f-4706-83ff-ae91b89b9fb6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:46:51.286640 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:51.296685 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:51.307311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.308347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.309069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.310215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.310827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.311408 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.353041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ef84f220-1091-488b-9983-2bbbe6c8dad1 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070745 Sep 28 15:46:51.359929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 351/694] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:46:51 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:46:51.467245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:51.467812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:51.480983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.481480 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.482217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.483222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.484616 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.485443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.521605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:51.530500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:46:51.535169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:51.549402 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.549913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.551152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.552945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.553421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.553878 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.650863 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3b3bdf1b-a7c5-433e-a1af-ea3430147d74 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 204 len: 0 microversion: 2.1 time: 0.198878 Sep 28 15:46:51.654437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 344/695] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:46:51 2022] DELETE /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:46:51.662526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:51.663449 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:51.668379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:51.670694 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.672046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.673311 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.674411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:51.675039 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:51.675626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:51.679652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0d1940d8-1dee-4b77-a10b-26db6bb82810 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1615 microversion: 2.1 time: 0.161755 Sep 28 15:46:51.681272 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 352/696] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:51 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1615 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:51.891347 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:51.900363 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1ce85101-c573-421e-8df1-e778a7102223 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1689 microversion: 2.1 time: 0.244193 Sep 28 15:46:51.915862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 345/697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:51 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:46:52.628021 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-326af489-01a5-4185-97bd-0b62351a5188 req-17bc4a1d-9a67-4d2f-9faa-6b12526b5bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90517e8-f8ed-480c-9005-afe1f77323e8", "name": "network-vif-deleted", "tag": "83666e16-8db0-45d5-8036-9477437e4471"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:52.638753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-326af489-01a5-4185-97bd-0b62351a5188 req-17bc4a1d-9a67-4d2f-9faa-6b12526b5bf8 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:52.639229 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-326af489-01a5-4185-97bd-0b62351a5188 req-17bc4a1d-9a67-4d2f-9faa-6b12526b5bf8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:52.639652 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-326af489-01a5-4185-97bd-0b62351a5188 req-17bc4a1d-9a67-4d2f-9faa-6b12526b5bf8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:52.651209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-326af489-01a5-4185-97bd-0b62351a5188 req-17bc4a1d-9a67-4d2f-9faa-6b12526b5bf8 service nova] Creating event network-vif-deleted:83666e16-8db0-45d5-8036-9477437e4471 for instance a90517e8-f8ed-480c-9005-afe1f77323e8 on hv-cinder-85931 Sep 28 15:46:52.668211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-326af489-01a5-4185-97bd-0b62351a5188 req-17bc4a1d-9a67-4d2f-9faa-6b12526b5bf8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043665 Sep 28 15:46:52.669532 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 353/698] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:52.704482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:52.705131 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:52.711779 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:52.712296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:52.712685 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:52.713562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:52.714046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:52.714709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:52.794768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:52.802987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b5e2f014-a1e1-424b-8109-d5b456f3d3b9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1615 microversion: 2.1 time: 0.102314 Sep 28 15:46:52.804283 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 346/699] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:52 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1615 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:52.929715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:52.931352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:52.937570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:52.938094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:52.938534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:52.939262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:52.939717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:52.940140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:53.077173 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:53.085059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-083ebc87-e955-4bdc-abfc-bc558b628527 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1689 microversion: 2.1 time: 0.160440 Sep 28 15:46:53.085570 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 354/700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:52 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:53.828599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:53.829197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:53.835499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:53.835971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:53.836406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:53.837083 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:53.837530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:53.837976 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:53.899755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:53.907316 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f5096b10-7c34-4530-bfb2-ec09e52d678b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1615 microversion: 2.1 time: 0.082650 Sep 28 15:46:53.907861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 347/701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:53 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1615 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:54.108376 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:54.108961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:54.115690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:54.116178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:54.116616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:54.117614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:54.118103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:54.118530 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:54.246154 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:54.253858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-747d1c11-bed3-4ddd-8cdd-1dc06ddb43fa tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1689 microversion: 2.1 time: 0.149495 Sep 28 15:46:54.254443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 355/702] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:54 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:54.931381 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:54.932020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:54.938358 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:54.938834 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:54.939260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:54.939939 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:54.940382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:54.940799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:55.000929 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:55.008626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-dd1961eb-1f7f-495a-8255-57f2fd956c8d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1615 microversion: 2.1 time: 0.081561 Sep 28 15:46:55.009725 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 348/703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:54 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1615 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:55.276470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:55.277086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:55.283637 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:55.284121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:55.284556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:55.285249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:55.285704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:55.286150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:55.412604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:55.420828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-daf77c45-827c-466b-a0e1-a58f64bb18fe tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1689 microversion: 2.1 time: 0.148215 Sep 28 15:46:55.421398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 356/704] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:55 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:56.032437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:56.033051 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:56.039490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:56.039971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:56.040402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:56.041092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:56.041542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:56.041989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:56.073564 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:56.074137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:56.074792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:56.075356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lazy-loading 'fault' on Instance uuid a90517e8-f8ed-480c-9005-afe1f77323e8 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:56.121268 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:56.130241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7c0ffd2e-c515-46e3-abaa-5f8c15f1f55b tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 200 len: 1331 microversion: 2.1 time: 0.101318 Sep 28 15:46:56.144014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 349/705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:56 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:56.444335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:56.444937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:56.452022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:56.452508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:56.452936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:56.453627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:56.454102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:56.454526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:56.690483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:56.698917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4a7bfe6d-e540-451d-816b-2c6d8fa112cb tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1689 microversion: 2.1 time: 0.258378 Sep 28 15:46:56.699503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 357/706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:56 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1689 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:57.128499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-e558cab7-23f1-4ade-a19f-0993f80f24cb req-7b3ee28e-cc36-49c6-8ca3-2bb79eef962e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf736d9-c255-4f14-8763-4d61838297a8", "name": "network-vif-deleted", "tag": "df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:57.142211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-e558cab7-23f1-4ade-a19f-0993f80f24cb req-7b3ee28e-cc36-49c6-8ca3-2bb79eef962e service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.142750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-e558cab7-23f1-4ade-a19f-0993f80f24cb req-7b3ee28e-cc36-49c6-8ca3-2bb79eef962e service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.143174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-e558cab7-23f1-4ade-a19f-0993f80f24cb req-7b3ee28e-cc36-49c6-8ca3-2bb79eef962e service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.157094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:57.157593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-e558cab7-23f1-4ade-a19f-0993f80f24cb req-7b3ee28e-cc36-49c6-8ca3-2bb79eef962e service nova] Creating event network-vif-deleted:df145fb1-b5d6-48c5-9a5d-cf3d2b4e048b for instance cbf736d9-c255-4f14-8763-4d61838297a8 on hv-cinder-85931 Sep 28 15:46:57.158419 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:57.162947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-e558cab7-23f1-4ade-a19f-0993f80f24cb req-7b3ee28e-cc36-49c6-8ca3-2bb79eef962e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Sep 28 15:46:57.165397 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 350/707] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:57.172318 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.174447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.175938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.178455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.179044 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.185534 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.213712 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 HTTP/1.1 Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:46:57.215601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:46:57.217181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'a90517e8-f8ed-480c-9005-afe1f77323e8'} Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:57.218184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:46:57.219592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:57.220936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:57.221749 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ddc970ba-8ec1-455f-8b78-451b5332e116 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 404 len: 111 microversion: 2.1 time: 0.069667 Sep 28 15:46:57.222609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 358/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:57 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:46:57.233552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-19771b55-7823-4dd8-b6c5-45fa98a1967f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '.version_select at 0x7f1154e36c10>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:57.261027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-19771b55-7823-4dd8-b6c5-45fa98a1967f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-704133159" status: 202 len: 0 microversion: 2.1 time: 0.032657 Sep 28 15:46:57.262458 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 351/709] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 15:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-704133159 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:46:57.723884 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:57.724593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:57.732339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.733162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.734005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.734860 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.735777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.736437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.741201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:57.775614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:57.776582 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:57.777278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:57.777964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'fault' on Instance uuid cbf736d9-c255-4f14-8763-4d61838297a8 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:46:57.829609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:46:57.842957 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-76875a53-192b-42b7-a0a1-2da42e9e939a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 200 len: 1335 microversion: 2.1 time: 0.122884 Sep 28 15:46:57.844768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 359/710] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:57 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 1335 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:46:58.048181 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d19d1cc3-223e-44a1-b467-725e11262a5d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: .version_select at 0x7f1154e75ca0>, body: {"keypair": {"name": "tempest-keypair-879613123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyDks9NTMZLQLKfJELCZTzASsrbvtMNOW1X8sYUNdmUyWs5WUXEaASEFvj+DJDVOM1Fjvo/9bCwa7M/puqkvc61zqFml3hdO7RsIwonCuEo7SdE4VUHoR/+SaH1rBIIvQ=="}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:58.063190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-d19d1cc3-223e-44a1-b467-725e11262a5d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:58.064602 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:46:58.068776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-d19d1cc3-223e-44a1-b467-725e11262a5d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:58.094782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d19d1cc3-223e-44a1-b467-725e11262a5d tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050573 Sep 28 15:46:58.095299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 352/711] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:46:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:46:58.869531 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:58.870372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: cbf736d9-c255-4f14-8763-4d61838297a8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:46:58.880032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:58.880670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:58.881299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:58.882270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:58.883350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:58.883944 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:58.902927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] HTTP exception thrown: Instance cbf736d9-c255-4f14-8763-4d61838297a8 could not be found. Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Request method failure captured: Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 HTTP/1.1 Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs3ZKCm3aPR4SQ3jxI_H_A6V2-5NKmOzV6VGR_hY79N9a9rR6iU_UYFiwx99PuQizzzVQ08loaV8DD6nQ0bQj3UMJHIQiO0SvAZlbdaVXFFzXyRLZE3mHa4XGwobxC5aE0I-lPu2kyxRrXRtrZmyoF8pyUj8_Ss1aHoEA8DC3PtyA4 Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:46:58.904869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_824ddb9f6f344a2684cf31d08427306c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 36515ae6f91748babdcf6a9a72f59ed1 Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance cbf736d9-c255-4f14-8763-4d61838297a8 could not be found. Sep 28 15:46:58.906246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'cbf736d9-c255-4f14-8763-4d61838297a8'} Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbf736d9-c255-4f14-8763-4d61838297a8 could not be found. Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:46:58.907085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbf736d9-c255-4f14-8763-4d61838297a8 could not be found. Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbf736d9-c255-4f14-8763-4d61838297a8 could not be found. Sep 28 15:46:58.908276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:46:58.909995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Returning 404 to user: Instance cbf736d9-c255-4f14-8763-4d61838297a8 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:46:58.910971 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8c569845-0583-4241-b73f-0c2d1fafb651 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8" status: 404 len: 111 microversion: 2.1 time: 0.047575 Sep 28 15:46:58.911931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 360/712] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:46:58 2022] GET /compute/v2.1/servers/cbf736d9-c255-4f14-8763-4d61838297a8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:46:58.921624 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8298852c-980f-4d35-8fab-eac71965651e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '.version_select at 0x7f1154e470d0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:46:58.945468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8298852c-980f-4d35-8fab-eac71965651e tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717174622" status: 202 len: 0 microversion: 2.1 time: 0.027503 Sep 28 15:46:58.946338 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 353/713] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 15:46:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717174622 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:46:59.403353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2146329058", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df05fe18-9205-4e7c-b6d8-ac63aa67e1aa"}], "security_groups": [{"name": "tempest-securitygroup--1532976796"}], "key_name": "tempest-keypair-879613123", "user_data": "}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:46:59.509094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] validate_networks() for [('df05fe18-9205-4e7c-b6d8-ac63aa67e1aa', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:46:59.948096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:46:59.948695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:46:59.949003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:46:59.949407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:46:59.949812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:46:59.958522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:59.959001 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:59.959431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:59.960151 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:46:59.961114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:46:59.961533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:46:59.978517 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:46:59.982514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Getting quotas for user f22b26ed7a47480e8448175517170172 and project 4eacc288ff1c40c8877635b387ffc3bc. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:46:59.993913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:46:59.996203 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:47:00.042728 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-12fa4fbd-e56e-4558-b81b-b62f2bffea78 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.643614 Sep 28 15:47:00.043673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 361/714] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:46:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:47:00.055228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a657d0e0-e3a5-47ae-a77d-1bd00470dd80 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:00.055958 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a657d0e0-e3a5-47ae-a77d-1bd00470dd80 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:00.113382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a657d0e0-e3a5-47ae-a77d-1bd00470dd80 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:00.123464 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a657d0e0-e3a5-47ae-a77d-1bd00470dd80 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1241 microversion: 2.1 time: 0.072807 Sep 28 15:47:00.124032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 354/715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:00 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:01.147531 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:01.148696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:01.155586 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:01.156072 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:01.156512 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:01.157288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:01.157745 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:01.158198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:01.220987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:01.228857 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6864b406-4182-46a5-b8bf-dd8f18389026 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1245 microversion: 2.1 time: 0.085739 Sep 28 15:47:01.229429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 362/716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:01 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:02.251573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:02.252267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:02.259841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:02.260328 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:02.260776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:02.261777 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:02.262269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:02.262708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:02.327887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:02.335951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c7840900-4bcd-4fea-aac3-51248c1f716f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1245 microversion: 2.1 time: 0.087912 Sep 28 15:47:02.336526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 355/717] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:02 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:03.363615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:03.366207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:03.373663 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:03.374174 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:03.374682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:03.375626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:03.376066 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:03.376481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:03.441158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:03.450351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ef4b99a0-0a15-4643-a5f4-fbdc6bebf4b7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1293 microversion: 2.1 time: 0.094713 Sep 28 15:47:03.450954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 363/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:03 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:03.958517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:03.959096 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:03.966068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:03.966555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:03.966982 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:03.967869 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:03.968475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:03.969113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.000365 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:47:04.060026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:04.091207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-09fb86ca-0ab4-4ea3-88d3-dba905b3b821 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 204 len: 0 microversion: 2.1 time: 0.136810 Sep 28 15:47:04.092348 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 356/719] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:47:03 2022] DELETE /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:47:04.101288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:04.101867 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:04.108271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.108760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.109205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.110049 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.110507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.110932 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.313165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:04.320796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fd2246d8-3299-468a-853f-f2d111997510 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1507 microversion: 2.1 time: 0.224027 Sep 28 15:47:04.321530 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 364/720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:04 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:04.475670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:04.476938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:04.482728 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.483197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.483623 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.484414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:04.484756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:04.485176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:04.549524 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:04.557357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0be1b62a-f788-4411-b8e0-7877562c4797 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1299 microversion: 2.1 time: 0.085887 Sep 28 15:47:04.557944 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 357/721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:04 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:05.344115 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:05.344716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:05.350738 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:05.351219 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:05.351649 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:05.352327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:05.352775 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:05.353193 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:05.481657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:05.489282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-09e73f02-9d99-49d0-b1b4-5a108f44f3a0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1507 microversion: 2.1 time: 0.149206 Sep 28 15:47:05.489839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 365/722] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:05 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:05.580380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:05.580978 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:05.587279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:05.587751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:05.588177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:05.588858 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:05.589299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:05.589714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:05.649419 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:05.656930 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6ee7b5d8-a628-4681-a3a5-5bbef22d23d4 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1299 microversion: 2.1 time: 0.080367 Sep 28 15:47:05.657474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 358/723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:05 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1299 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:06.513116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:06.513723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:06.520260 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:06.520739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:06.521177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:06.521884 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:06.522337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:06.523336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:06.679840 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:06.680541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:06.686734 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:06.687312 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:06.687822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:06.688594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:06.689048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:06.689548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:06.718778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:06.727321 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2407cf7c-5054-424e-af44-2b1aacda51d0 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1507 microversion: 2.1 time: 0.217982 Sep 28 15:47:06.741981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 366/724] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:06 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:06.760923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:06.768510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2ae5f8a5-f978-4266-bc63-497e309645de tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1299 microversion: 2.1 time: 0.093020 Sep 28 15:47:06.769271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 359/725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:06 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:07.529633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-0450a790-cfa2-45b2-afc6-da618837ad26 req-c3ebbbf0-ddf8-4d78-84bc-2fabcfc99796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69488fec-c032-4a06-aebf-169b15da1e74", "name": "network-vif-deleted", "tag": "41aaafcb-981e-4fbf-8c80-bbb43167a049"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:07.552622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0450a790-cfa2-45b2-afc6-da618837ad26 req-c3ebbbf0-ddf8-4d78-84bc-2fabcfc99796 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.555503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0450a790-cfa2-45b2-afc6-da618837ad26 req-c3ebbbf0-ddf8-4d78-84bc-2fabcfc99796 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.556600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0450a790-cfa2-45b2-afc6-da618837ad26 req-c3ebbbf0-ddf8-4d78-84bc-2fabcfc99796 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.572043 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-0450a790-cfa2-45b2-afc6-da618837ad26 req-c3ebbbf0-ddf8-4d78-84bc-2fabcfc99796 service nova] Creating event network-vif-deleted:41aaafcb-981e-4fbf-8c80-bbb43167a049 for instance 69488fec-c032-4a06-aebf-169b15da1e74 on hv-cinder-85931 Sep 28 15:47:07.577552 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-0450a790-cfa2-45b2-afc6-da618837ad26 req-c3ebbbf0-ddf8-4d78-84bc-2fabcfc99796 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054471 Sep 28 15:47:07.578785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 367/726] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:07.752883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:07.753499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:07.762983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.763870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.764484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.765378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.766056 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.766477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.792289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:07.793385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:07.801513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.802345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.803243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.804501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.805515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.806317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.825950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:07.828849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:07.830897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:07.831785 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'fault' on Instance uuid 69488fec-c032-4a06-aebf-169b15da1e74 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:07.931174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:07.938844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c8235798-4156-4e18-8ad7-6758a97d0f9a tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 200 len: 1312 microversion: 2.1 time: 0.190241 Sep 28 15:47:07.939423 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 360/727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:07 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:08.084691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:08.094847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-234ae8ea-11c8-4530-ae0b-d4c12e1582c3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1367 microversion: 2.1 time: 0.307318 Sep 28 15:47:08.095691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 368/728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:07 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:08.962867 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:08.963485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: 69488fec-c032-4a06-aebf-169b15da1e74] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:08.969898 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:08.970373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:08.970816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:08.971502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:08.971955 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:08.972380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:08.986082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] HTTP exception thrown: Instance 69488fec-c032-4a06-aebf-169b15da1e74 could not be found. Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Request method failure captured: Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 HTTP/1.1 Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs3ZKCm3aPR4SQ3jxI_H_A6V2-5NKmOzV6VGR_hY79N9a9rR6iU_UYFiwx99PuQizzzVQ08loaV8DD6nQ0bQj3UMJHIQiO0SvAZlbdaVXFFzXyRLZE3mHa4XGwobxC5aE0I-lPu2kyxRrXRtrZmyoF8pyUj8_Ss1aHoEA8DC3PtyA4 Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:47:08.987628 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_824ddb9f6f344a2684cf31d08427306c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 36515ae6f91748babdcf6a9a72f59ed1 Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 69488fec-c032-4a06-aebf-169b15da1e74 could not be found. Sep 28 15:47:08.989186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '69488fec-c032-4a06-aebf-169b15da1e74'} Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69488fec-c032-4a06-aebf-169b15da1e74 could not be found. Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:47:08.990093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69488fec-c032-4a06-aebf-169b15da1e74 could not be found. Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69488fec-c032-4a06-aebf-169b15da1e74 could not be found. Sep 28 15:47:08.991546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:08.993124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Returning 404 to user: Instance 69488fec-c032-4a06-aebf-169b15da1e74 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:47:08.993124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0efa154b-b6c0-4ed1-9ffa-9bea029e5811 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74" status: 404 len: 111 microversion: 2.1 time: 0.030542 Sep 28 15:47:08.993124 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 361/729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:08 2022] GET /compute/v2.1/servers/69488fec-c032-4a06-aebf-169b15da1e74 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:47:08.997771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:08.998299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:09.005422 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.005959 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.006420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.007104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.007558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.007991 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.032617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:47:09.108953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ec9167b8-68c3-42b0-b3c8-48231d52af55 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 204 len: 0 microversion: 2.1 time: 0.114654 Sep 28 15:47:09.109540 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 369/730] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:47:08 2022] DELETE /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:47:09.117799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:09.118433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:09.119427 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:09.120155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:09.124298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.124771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.125207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.125771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.125936 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.126284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.126428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.126713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.126827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.127392 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.127840 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.128261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.326100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:09.329269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:09.333741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8afc999a-ebda-4040-b267-315fbb221518 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.220010 Sep 28 15:47:09.334520 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 362/731] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:09 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:09.338633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e1dc4f0b-20ac-49fe-b2d8-85839ebee689 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1367 microversion: 2.1 time: 0.223334 Sep 28 15:47:09.339196 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 370/732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:09 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:09.628134 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-cfd8d5a7-c4bc-4aa5-8795-38f3a5728ee5 req-47d22c72-d42d-40fc-a42e-abc28d9109d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1d44bc-cd43-48ca-83f5-51d4a5635c8d", "tag": "67ca7698-c1f0-4995-8fbd-1baf4a653918"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:09.637414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-cfd8d5a7-c4bc-4aa5-8795-38f3a5728ee5 req-47d22c72-d42d-40fc-a42e-abc28d9109d8 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:09.637906 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-cfd8d5a7-c4bc-4aa5-8795-38f3a5728ee5 req-47d22c72-d42d-40fc-a42e-abc28d9109d8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:09.638335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-cfd8d5a7-c4bc-4aa5-8795-38f3a5728ee5 req-47d22c72-d42d-40fc-a42e-abc28d9109d8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:09.648774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-cfd8d5a7-c4bc-4aa5-8795-38f3a5728ee5 req-47d22c72-d42d-40fc-a42e-abc28d9109d8 service nova] Creating event network-changed:67ca7698-c1f0-4995-8fbd-1baf4a653918 for instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d on hv-cinder-85931 Sep 28 15:47:09.653501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-cfd8d5a7-c4bc-4aa5-8795-38f3a5728ee5 req-47d22c72-d42d-40fc-a42e-abc28d9109d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029158 Sep 28 15:47:09.654102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 363/733] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:10.356478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:10.357246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:10.358084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:10.359961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:10.360682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:10.362197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:10.362323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:10.362892 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:10.368886 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:10.369460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:10.369910 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:10.370026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:10.370497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:10.370603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:10.370930 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:10.371163 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:10.371607 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:10.371719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:10.372054 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:10.372668 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:10.578369 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:10.586561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:10.587956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e0f47f35-f0e9-47ab-a9f9-1d8a80ad1385 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1367 microversion: 2.1 time: 0.231251 Sep 28 15:47:10.589428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 364/734] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:10 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:10.598887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4d2a1326-538f-43d2-9a5d-008e91fdf825 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.246240 Sep 28 15:47:10.599885 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 371/735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:10 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:11.610546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:11.611146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:11.618903 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:11.619382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:11.619815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:11.620567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:11.621048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:11.621438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:11.624120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:11.624833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:11.631818 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:11.632393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:11.632910 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:11.633690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:11.634274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:11.634834 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:11.821608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:11.825434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:11.831172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7cc973b7-09b7-41c7-be5b-83f3bda50480 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.211959 Sep 28 15:47:11.832302 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 372/736] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:11 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:11.834476 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cf3e3d3b-8742-4e5c-86a1-cf8a36da2f0f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1367 microversion: 2.1 time: 0.227527 Sep 28 15:47:11.835088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 365/737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:11 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:12.576522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-f8abbad1-1668-4973-98c2-7a29d61d001d req-17551d3d-595c-42e9-bc9f-1a499e38e9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1d44bc-cd43-48ca-83f5-51d4a5635c8d", "name": "network-vif-plugged", "status": "completed", "tag": "67ca7698-c1f0-4995-8fbd-1baf4a653918"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:12.586969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-f8abbad1-1668-4973-98c2-7a29d61d001d req-17551d3d-595c-42e9-bc9f-1a499e38e9c5 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.587466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-f8abbad1-1668-4973-98c2-7a29d61d001d req-17551d3d-595c-42e9-bc9f-1a499e38e9c5 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.587882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-f8abbad1-1668-4973-98c2-7a29d61d001d req-17551d3d-595c-42e9-bc9f-1a499e38e9c5 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:12.599112 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-f8abbad1-1668-4973-98c2-7a29d61d001d req-17551d3d-595c-42e9-bc9f-1a499e38e9c5 service nova] Creating event network-vif-plugged:67ca7698-c1f0-4995-8fbd-1baf4a653918 for instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d on hv-cinder-85931 Sep 28 15:47:12.603826 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-f8abbad1-1668-4973-98c2-7a29d61d001d req-17551d3d-595c-42e9-bc9f-1a499e38e9c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031082 Sep 28 15:47:12.604561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 373/738] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:12.856037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:12.856776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:12.860469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:12.861170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:12.863755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.864308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.864813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:12.865582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.866169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.866923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:12.868208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.868689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.869142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:12.869811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:12.870291 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:12.870788 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:13.343618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:13.349497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:13.352212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c8b5e555-3424-4569-9b5b-6a39563ed0dc tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1521 microversion: 2.1 time: 0.499628 Sep 28 15:47:13.352973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 366/739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:12 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:13.359327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d09ba914-5995-449b-b62b-d9c759fb9f03 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1367 microversion: 2.1 time: 0.503315 Sep 28 15:47:13.359990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 374/740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:12 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:13.425296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:13.425804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:13.431731 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:13.432213 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:13.432647 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:13.433340 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:13.433796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:13.434250 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:13.456861 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0873c3c1-ecbf-4ba2-9dc8-59e315edd2f6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/ips" status: 200 len: 152 microversion: 2.20 time: 0.088668 Sep 28 15:47:13.457411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 367/741] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Sep 28 15:47:13 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/ips => generated 152 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:47:13.887560 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-6c8a255b-dbd4-496a-bdb5-b9ef0853b196 req-f0634eab-fcad-40f9-8eb9-53eea6ae6319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ad4def-5dcf-41f5-be4c-e251a8e878af", "name": "network-vif-deleted", "tag": "55efe6f9-e65a-4754-9095-ac7b9f3c3e10"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:13.896969 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-6c8a255b-dbd4-496a-bdb5-b9ef0853b196 req-f0634eab-fcad-40f9-8eb9-53eea6ae6319 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:13.897449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-6c8a255b-dbd4-496a-bdb5-b9ef0853b196 req-f0634eab-fcad-40f9-8eb9-53eea6ae6319 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:13.897903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-6c8a255b-dbd4-496a-bdb5-b9ef0853b196 req-f0634eab-fcad-40f9-8eb9-53eea6ae6319 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:13.909371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-6c8a255b-dbd4-496a-bdb5-b9ef0853b196 req-f0634eab-fcad-40f9-8eb9-53eea6ae6319 service nova] Creating event network-vif-deleted:55efe6f9-e65a-4754-9095-ac7b9f3c3e10 for instance d9ad4def-5dcf-41f5-be4c-e251a8e878af on hv-cinder-85931 Sep 28 15:47:13.914250 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-6c8a255b-dbd4-496a-bdb5-b9ef0853b196 req-f0634eab-fcad-40f9-8eb9-53eea6ae6319 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095565 Sep 28 15:47:13.914841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 375/742] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:47:14.379027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:14.380286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:14.389084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.389669 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:14.389872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.390409 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.390526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:14.391286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.391843 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.392503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.396664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.397358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.397799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.398565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.399022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.399529 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.426247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:14.427083 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:14.427762 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:14.428473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lazy-loading 'fault' on Instance uuid d9ad4def-5dcf-41f5-be4c-e251a8e878af {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:14.535889 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36515ae6f91748babdcf6a9a72f59ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '824ddb9f6f344a2684cf31d08427306c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:14.546224 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-120579f8-c1df-469c-aac1-a9a795e956f8 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 200 len: 1312 microversion: 2.1 time: 0.170801 Sep 28 15:47:14.547055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 368/743] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:14 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:14.700860 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:14.708681 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-319f0f41-2b88-425b-afde-f944f551a927 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1367 microversion: 2.1 time: 0.323187 Sep 28 15:47:14.709256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 376/744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:14 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:47:15.571522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:15.572156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] [instance: d9ad4def-5dcf-41f5-be4c-e251a8e878af] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:15.578492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.578973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.579401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.580079 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.580640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.580932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.594368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] HTTP exception thrown: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af could not be found. Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Request method failure captured: Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af HTTP/1.1 Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs3ZKCm3aPR4SQ3jxI_H_A6V2-5NKmOzV6VGR_hY79N9a9rR6iU_UYFiwx99PuQizzzVQ08loaV8DD6nQ0bQj3UMJHIQiO0SvAZlbdaVXFFzXyRLZE3mHa4XGwobxC5aE0I-lPu2kyxRrXRtrZmyoF8pyUj8_Ss1aHoEA8DC3PtyA4 Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:47:15.595956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/824ddb9f6f344a2684cf31d08427306c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_824ddb9f6f344a2684cf31d08427306c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 824ddb9f6f344a2684cf31d08427306c Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-886308406 Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 36515ae6f91748babdcf6a9a72f59ed1 Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-ServerRescueNegativeTestJSON-886308406-project Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af could not be found. Sep 28 15:47:15.597593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': 'd9ad4def-5dcf-41f5-be4c-e251a8e878af'} Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af could not be found. Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:47:15.598669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af could not be found. Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af could not be found. Sep 28 15:47:15.600195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:15.601625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] Returning 404 to user: Instance d9ad4def-5dcf-41f5-be4c-e251a8e878af could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:47:15.601625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-829bc5ca-0f0d-46a5-bc3a-e76b79678385 tempest-ServerRescueNegativeTestJSON-886308406 tempest-ServerRescueNegativeTestJSON-886308406-project] 10.222.0.52 "GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af" status: 404 len: 111 microversion: 2.1 time: 0.030208 Sep 28 15:47:15.601625 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 369/745] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:15 2022] GET /compute/v2.1/servers/d9ad4def-5dcf-41f5-be4c-e251a8e878af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:47:15.731842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:15.732476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:15.738834 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.739312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.739741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.740425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.740880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.741326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.746094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:15.955131 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:15.962808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8e845281-ca60-491b-80d4-72dd75306334 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1557 microversion: 2.1 time: 0.234733 Sep 28 15:47:15.963379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 377/746] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:15 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1557 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:15.985256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:15.985742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:15.992354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.992830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.993253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:15.993959 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:15.994403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:15.994821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.009785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:16.010423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:16.016624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:16.017121 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:16.017565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.018281 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:16.018735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:16.019156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.042073 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lazy-loading 'flavor' on Instance uuid 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:16.099740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-91bf62a7-2d96-41c4-8b39-f3e7336f3e5c tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118275 Sep 28 15:47:16.100748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 370/747] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 15:47:15 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:16.245593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-91c53c03-f3fb-4df0-8eb8-375e00cbf093 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/action" status: 202 len: 0 microversion: 2.20 time: 0.240086 Sep 28 15:47:16.246925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 378/748] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 15:47:16 2022] POST /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:47:16.255896 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:16.256816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:16.266212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:16.266972 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:16.268372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.269491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:16.270823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:16.271446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:16.508469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:16.518054 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:16.519860 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:16.521053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3418ee38-5e3d-4680-b90b-3ad5043f49f8 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.269914 Sep 28 15:47:16.521610 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 371/749] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:16 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:17.415675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-0804de26-1b49-493e-bd85-3f686003b279 req-02bb7684-a0cb-48a9-bd70-84f477c76e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e1d44bc-cd43-48ca-83f5-51d4a5635c8d", "tag": "67ca7698-c1f0-4995-8fbd-1baf4a653918"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:17.431341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0804de26-1b49-493e-bd85-3f686003b279 req-02bb7684-a0cb-48a9-bd70-84f477c76e12 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:17.432076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0804de26-1b49-493e-bd85-3f686003b279 req-02bb7684-a0cb-48a9-bd70-84f477c76e12 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:17.432833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-0804de26-1b49-493e-bd85-3f686003b279 req-02bb7684-a0cb-48a9-bd70-84f477c76e12 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:17.445756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-0804de26-1b49-493e-bd85-3f686003b279 req-02bb7684-a0cb-48a9-bd70-84f477c76e12 service nova] Creating event network-changed:67ca7698-c1f0-4995-8fbd-1baf4a653918 for instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d on hv-cinder-85931 Sep 28 15:47:17.452309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-0804de26-1b49-493e-bd85-3f686003b279 req-02bb7684-a0cb-48a9-bd70-84f477c76e12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177115 Sep 28 15:47:17.453522 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 379/750] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:17.548944 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:17.549535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:17.561366 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:17.562407 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:17.563014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:17.563742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:17.564196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:17.564618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:17.814588 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:17.824360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:17.828604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:17.832611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9f937d91-1d04-424a-b164-543b97c8df3d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.287953 Sep 28 15:47:17.834104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 372/751] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:17 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:18.866022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:18.869780 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:18.882823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:18.883331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:18.883770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:18.884480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:18.884933 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:18.885361 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:19.036215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:19.050290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:19.053245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:19.055251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ae8ca7c0-683d-4fc6-ba9b-47a817c3fe7e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.198079 Sep 28 15:47:19.056017 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 380/752] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:18 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:20.081047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:20.081682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:20.088998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:20.089476 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:20.089929 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:20.090620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:20.091064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:20.091482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:20.227428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:20.235641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:20.237051 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:20.238256 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cbcab318-cc21-4e93-a067-41f69c79a2f1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.161170 Sep 28 15:47:20.238800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 373/753] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:20 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:21.264530 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:21.265169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:21.272083 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:21.272566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:21.273030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:21.273731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:21.274209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:21.274631 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:21.405357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:21.414245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:21.415690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:21.416845 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-231a484f-5e56-41c0-a8ed-f004a8e82347 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.156266 Sep 28 15:47:21.417405 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 381/754] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:21 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:22.441171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:22.441893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:22.449196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:22.449767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:22.450295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:22.451064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:22.451592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:22.452093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:22.581016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:22.588992 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:22.590685 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:22.591849 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e416bc51-346f-4f63-be05-3802be550cad tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.154631 Sep 28 15:47:22.592403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 374/755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:22 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:23.616613 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:23.617226 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:23.623795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:23.624276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:23.624712 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:23.625405 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:23.625879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:23.626313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:23.758951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:23.767628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:23.769076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:23.770280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-33cf4d54-50ef-4a85-ade6-c231d9a40fe1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.157767 Sep 28 15:47:23.770845 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 382/756] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:23 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:24.796173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:24.796778 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:24.803505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:24.803991 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:24.804442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:24.805141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:24.805603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:24.806069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:24.825517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=100 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:24.940820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:24.948872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:24.950519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:24.952130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0b2793bf-6ad2-4c8b-a01b-efa9a6b70b6a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.159645 Sep 28 15:47:24.952641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 375/757] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:24 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:25.978513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:25.979123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:25.985597 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:25.986114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:25.986551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:25.987243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:25.987695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:25.988116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:26.121119 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:26.129492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:26.130974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:26.132143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f693a151-e4cc-494d-9390-bcc65ba7db2a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.158071 Sep 28 15:47:26.132713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 383/758] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:25 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:27.159542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:27.160138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:27.166766 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:27.167237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:27.167666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:27.168351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:27.168794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:27.169208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:27.300586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:27.309572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:27.311088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:27.312378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-01a32901-e5d7-46d4-8909-1be42498f0ae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.157871 Sep 28 15:47:27.312927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 376/759] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:27 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:28.337317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:28.337950 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:28.344723 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:28.345201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:28.345630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:28.346364 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:28.346815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:28.347336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:28.480974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:28.489130 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:28.490610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:28.492023 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-64edfd2e-b6b0-4f66-9527-2490f4df5341 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.158674 Sep 28 15:47:28.492580 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 384/760] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:28 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:28.861705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:28.862945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:28.867530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:28.873441 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:28.874223 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:28.875031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:28.875833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:28.876287 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:28.876796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:28.903974 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0b8832f6-f810-4205-83bd-192e3e25a419 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/ips" status: 200 len: 144 microversion: 2.1 time: 0.048775 Sep 28 15:47:28.904583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 377/761] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:47:28 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/ips => generated 144 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:29.517420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:29.518059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:29.524902 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:29.525388 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:29.525822 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:29.526600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:29.527054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:29.527476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:29.665799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:29.673980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:29.675423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:29.676572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f061a5c5-8887-4121-b326-f96eb6051f42 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.163160 Sep 28 15:47:29.677126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 385/762] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:29 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:30.239375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ce759b4-4927-4cee-99bf-aa021962906a"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:30.242072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:30.248748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:30.249229 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:30.249661 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:30.250381 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:30.250836 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:30.251346 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:30.494421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e40b5ebb-cfbb-43cd-af5a-4a79bf69c6d5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258729 Sep 28 15:47:30.495014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 378/763] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:47:30 2022] POST /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:30.701762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:30.702503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:30.709043 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:30.709536 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:30.709995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:30.710711 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:30.711206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:30.711644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:30.843729 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:30.852358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:30.853880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:30.855035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f3e9ef8c-b88c-48b7-bee6-1349c5cb7168 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.157227 Sep 28 15:47:30.855617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 386/764] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:30 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:31.881521 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:31.882728 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:31.888901 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:31.889379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:31.889813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:31.890530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:31.891089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:31.891554 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:32.024947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:32.032844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:32.034293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:32.035446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-05ab2129-fec4-4ead-b32f-04c5f89cceba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.158625 Sep 28 15:47:32.035992 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 379/765] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:31 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:33.060658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:33.061413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:33.069100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:33.069587 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:33.070060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:33.070770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:33.071228 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:33.071655 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:33.203705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:33.212565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:33.214056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:33.215210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9d254dee-cc4a-49de-87dc-f74d81736c95 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.158484 Sep 28 15:47:33.215811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 387/766] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:33 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:34.241795 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:34.243017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:34.249530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:34.250053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:34.250492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:34.251183 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:34.251640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:34.252070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:34.381515 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:34.389600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:34.391059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:34.392221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-122fc2c6-d4d0-4fd8-aaa6-b1e5558e2f24 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.155436 Sep 28 15:47:34.392773 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 380/767] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:34 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:35.417581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:35.418215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:35.424204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:35.424675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:35.425102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:35.425783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:35.426259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:35.426677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:35.798287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:35.807153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:35.808606 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:35.809779 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2d3aa559-17d4-4d71-beb2-3b851e7ae50d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.396279 Sep 28 15:47:35.810428 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 388/768] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:35 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:36.838999 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:36.839601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:36.846279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:36.846751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:36.847176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:36.847854 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:36.848300 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:36.848716 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:36.980799 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:36.988774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:36.990235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:36.991640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2b2176fd-5314-4a47-a163-d2258ac41d4e tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.156579 Sep 28 15:47:36.992794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 381/769] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:36 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:38.016490 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:38.017104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:38.024036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.024527 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.024965 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.025664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.026162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.026595 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.039417 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:38.041638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:38.048642 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.049129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.049556 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.050291 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.050741 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.051157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.081562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a8bc50d7-62e3-4306-83bb-4fc9f59d2abe tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045980 Sep 28 15:47:38.082147 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 382/770] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:47:38 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:38.093371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:38.093884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:38.099730 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.100210 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.100644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.101343 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:38.101796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:38.102250 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:38.131430 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8a480b13-7be9-45f9-bf43-551e3b3e04c1 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/1ce759b4-4927-4cee-99bf-aa021962906a" status: 200 len: 194 microversion: 2.1 time: 0.041928 Sep 28 15:47:38.132017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 383/771] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 15:47:38 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/1ce759b4-4927-4cee-99bf-aa021962906a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:47:38.162922 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:38.171459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:38.173820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:38.175207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c88a0d96-6a14-4072-af73-2bc37733b4a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1745 microversion: 2.20 time: 0.162397 Sep 28 15:47:38.175771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 389/772] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:38 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:39.201642 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:39.202189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:39.208620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:39.209101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:39.209535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:39.210252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:39.211222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:39.211644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:39.340609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:39.348659 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:39.350130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:39.351410 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4c79d386-5b24-460e-aa07-e7141f95d549 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1745 microversion: 2.20 time: 0.153594 Sep 28 15:47:39.351945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 384/773] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:39 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:39.473452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc649568-475a-4e9c-8ab5-5858a7b0ac6f"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:39.475852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:39.482314 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:39.482800 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:39.483231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:39.483921 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:39.484374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:39.484792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:39.746853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5a3c6505-6dea-40ba-8662-c4cfb3b7fe17 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "POST /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277260 Sep 28 15:47:39.747547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 390/774] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:47:39 2022] POST /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:40.375484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:40.376089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:40.382450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:40.382927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:40.383361 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:40.384068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:40.384497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:40.384917 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:40.514386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:40.522611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:40.524603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:40.525758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d546aca9-2cab-4121-a77f-f332137402ab tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1745 microversion: 2.20 time: 0.154080 Sep 28 15:47:40.526447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 385/775] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:40 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:41.554783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:41.555591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:41.573808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=40 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:41.576555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:41.577600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:41.578483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:41.579457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:41.580161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:41.580937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:41.623583 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:41.830181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:41.841665 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:41.843216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:41.844473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c996ad73-c4e2-4f7c-b1df-aa36a45742c5 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.295571 Sep 28 15:47:41.845106 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 391/776] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:41 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:42.894913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:42.897064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:42.906289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:42.906920 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:42.907448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:42.908460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:42.909447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:42.909962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:42.957310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-91a20802-2b67-478c-9a53-19eed157b27f req-25d4a84f-caf2-475c-afca-59f02baf0663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "name": "network-vif-plugged", "status": "completed", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:42.970338 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-91a20802-2b67-478c-9a53-19eed157b27f req-25d4a84f-caf2-475c-afca-59f02baf0663 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:42.971384 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-91a20802-2b67-478c-9a53-19eed157b27f req-25d4a84f-caf2-475c-afca-59f02baf0663 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:42.971996 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-91a20802-2b67-478c-9a53-19eed157b27f req-25d4a84f-caf2-475c-afca-59f02baf0663 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:42.989254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-91a20802-2b67-478c-9a53-19eed157b27f req-25d4a84f-caf2-475c-afca-59f02baf0663 service nova] Creating event network-vif-plugged:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:47:42.996533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-91a20802-2b67-478c-9a53-19eed157b27f req-25d4a84f-caf2-475c-afca-59f02baf0663 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250647 Sep 28 15:47:42.997680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 386/777] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:43.111068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:43.119664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:43.121401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:43.122630 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e635d47d-727a-41fb-8137-b565933aa0bd tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.246731 Sep 28 15:47:43.123190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 392/778] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:42 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:47:44.147853 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:44.148593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:44.155436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:44.155910 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:44.156337 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:44.157017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:44.157463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:44.157899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:44.355120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:44.364777 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:44.367053 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:44.369218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ebe8df5c-bc93-47a5-a89b-0d052c99e076 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.225417 Sep 28 15:47:44.369705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 387/779] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:44 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:45.394693 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:45.395462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:45.402312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:45.402903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:45.403430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:45.404353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:45.404909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:45.405600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:45.551392 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:45.563137 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:45.564616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:45.565792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3385cde4-ea73-47a3-ab61-976176a5cc88 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.174932 Sep 28 15:47:45.566771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 393/780] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:45 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:46.591371 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:46.592072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:46.598704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:46.599392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:46.599828 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:46.600555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:46.601327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:46.601979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:46.765448 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:46.774450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:46.776029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:46.779353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cf780ebe-1380-437f-bc9b-1bac018db266 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.192053 Sep 28 15:47:46.779949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 388/781] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:46 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:47.402240 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:47.404542 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:47.411841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.412637 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.413330 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.414253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.414744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.415134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.447871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6c7384ff-a8d8-4c0f-8b13-f064eead403f tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050012 Sep 28 15:47:47.450025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 394/782] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:47:47 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:47.599114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:47.599638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:47.606361 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.607057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.607491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.608212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.608699 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.609119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.643879 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6b89b256-9c40-4faa-8253-11bac75493e9 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/1ce759b4-4927-4cee-99bf-aa021962906a" status: 200 len: 194 microversion: 2.1 time: 0.048286 Sep 28 15:47:47.650064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 389/783] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 15:47:47 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/1ce759b4-4927-4cee-99bf-aa021962906a => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:47.660015 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:47.660584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:47.667024 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.667870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.668515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.669420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.670117 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.670603 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.764105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lazy-loading 'services' on Instance uuid aa320caa-d879-4630-95ed-d94d1aba1eba {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:47.809368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:47.810015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:47.816438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.816931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.817364 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.818126 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:47.819447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:47.820036 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:47.856698 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d181a6e1-0aa4-4663-84ae-e221224f5184 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/1ce759b4-4927-4cee-99bf-aa021962906a" status: 202 len: 0 microversion: 2.1 time: 0.200386 Sep 28 15:47:47.857214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 395/784] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:47:47 2022] DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/1ce759b4-4927-4cee-99bf-aa021962906a => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:47:47.996110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:48.004759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:48.006253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:48.007490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9d37c83b-df44-4148-87b3-bcae0bd78135 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.202182 Sep 28 15:47:48.008336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 390/785] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:47 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:49.034403 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:49.040887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:49.041758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:49.042670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:49.053919 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.054657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.055660 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.056473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.056954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.057566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.057709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.058372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.059146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.065569 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.066267 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.066715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.092724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:49.095693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1211885c-e439-43c7-8e6b-72b51fa330d4 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/fc649568-475a-4e9c-8ab5-5858a7b0ac6f" status: 200 len: 194 microversion: 2.1 time: 0.059278 Sep 28 15:47:49.097179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 391/786] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 15:47:49 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/fc649568-475a-4e9c-8ab5-5858a7b0ac6f => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:49.108110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:49.108762 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:49.123375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.124257 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.124923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.125880 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:49.126542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:49.127312 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:49.241869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:49.253627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:49.260248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:49.262828 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f20ebfa7-cb0c-42ed-88c4-1e67cd109c83 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.233456 Sep 28 15:47:49.265212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 396/787] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:49 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:49.265815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lazy-loading 'services' on Instance uuid aa320caa-d879-4630-95ed-d94d1aba1eba {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:49.376014 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1c4b4ae2-8d98-433f-bb72-56bb6d4859c8 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/fc649568-475a-4e9c-8ab5-5858a7b0ac6f" status: 202 len: 0 microversion: 2.1 time: 0.271620 Sep 28 15:47:49.380664 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 392/788] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:47:49 2022] DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments/fc649568-475a-4e9c-8ab5-5858a7b0ac6f => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:47:50.305384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:50.307566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:50.315197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.316070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.317524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.318510 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.319120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.320305 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.492444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:50.503376 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:50.506385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:50.507987 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-257b7011-f65a-4d10-b89d-60b20c8a0ad4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.222262 Sep 28 15:47:50.508748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 397/789] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:50 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:50.606704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:50.609950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:50.618408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.619060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.619501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.620276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.620902 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.621471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.652596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2360a86c-86a5-473a-a824-e1fc4f062560 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050044 Sep 28 15:47:50.653146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 393/790] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:47:50 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:47:50.782805 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:50.785217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:50.791991 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.792541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.793141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.793840 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.794362 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.794792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.825161 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ca06f3ba-18fb-43a1-9b88-ec7d24cf55fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046267 Sep 28 15:47:50.826160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 398/791] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:47:50 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:47:50.895829 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:50.896327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:50.902893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.903389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.903830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.904546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:50.904999 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:50.905426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:50.930846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:47:51.008038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ad427acf-6814-4d0a-86fb-6533249dce00 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 204 len: 0 microversion: 2.1 time: 0.115694 Sep 28 15:47:51.008869 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 394/792] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:47:50 2022] DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:47:51.018324 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:51.018929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:51.025484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:51.026040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:51.026497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:51.027174 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:51.027632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:51.028055 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:51.156708 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.165802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3cd9e83e-5778-46d5-b165-19da87e02c7a tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1672 microversion: 2.1 time: 0.152437 Sep 28 15:47:51.166412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 399/793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:51 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:51.534401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:51.535100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:51.541175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:51.541646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:51.542109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:51.542786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:51.543230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:51.543646 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:51.670391 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.678896 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.680348 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:51.681503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-442544b8-a053-41df-a7fb-8e85521cc090 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.151414 Sep 28 15:47:51.682093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 395/794] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:51 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:52.188635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:52.189302 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:52.196304 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:52.196785 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:52.197214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:52.197925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:52.198453 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:52.198815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:52.330086 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.338347 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a5bbde9f-4b41-46b9-aa87-2492bae0e446 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1672 microversion: 2.1 time: 0.153479 Sep 28 15:47:52.338907 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 400/795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:52 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:52.706844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:52.707391 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:52.713672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:52.714186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:52.714621 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:52.715341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:52.715796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:52.716218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:52.844241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.852680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.854132 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:52.855289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-08833b84-a151-42a9-b25e-ae841f518b03 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1740 microversion: 2.20 time: 0.152402 Sep 28 15:47:52.855839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 396/796] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:52 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:53.360758 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:53.361383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:53.368316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:53.368805 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:53.369243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:53.369964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:53.370421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:53.370898 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:53.667915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:53.675740 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3e588d48-8eb7-4f87-8de0-1e6fe16596ee tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1672 microversion: 2.1 time: 0.318987 Sep 28 15:47:53.676311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 401/797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:53 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1672 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:53.886226 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:53.890307 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:53.896605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:53.897172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:53.897677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:53.898416 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:53.898876 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:53.899305 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:54.114552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:54.126822 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:54.128345 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:54.129526 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3e29d855-6fb8-405a-abc8-97ef65acf665 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1722 microversion: 2.20 time: 0.252752 Sep 28 15:47:54.130120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 397/798] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:53 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:54.377707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-7812310d-ed85-44d4-950a-61fbbd4d34c5 req-e24048ed-9f4c-4fc8-921e-f302b6281c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa320caa-d879-4630-95ed-d94d1aba1eba", "name": "network-vif-deleted", "tag": "9f8defde-2966-4708-857b-a6dddf82eddc"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:54.388562 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-7812310d-ed85-44d4-950a-61fbbd4d34c5 req-e24048ed-9f4c-4fc8-921e-f302b6281c03 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:54.389037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-7812310d-ed85-44d4-950a-61fbbd4d34c5 req-e24048ed-9f4c-4fc8-921e-f302b6281c03 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:54.389462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-7812310d-ed85-44d4-950a-61fbbd4d34c5 req-e24048ed-9f4c-4fc8-921e-f302b6281c03 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:54.400371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-7812310d-ed85-44d4-950a-61fbbd4d34c5 req-e24048ed-9f4c-4fc8-921e-f302b6281c03 service nova] Creating event network-vif-deleted:9f8defde-2966-4708-857b-a6dddf82eddc for instance aa320caa-d879-4630-95ed-d94d1aba1eba on hv-cinder-85931 Sep 28 15:47:54.405468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-7812310d-ed85-44d4-950a-61fbbd4d34c5 req-e24048ed-9f4c-4fc8-921e-f302b6281c03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Sep 28 15:47:54.406084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 402/799] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:54.698980 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:54.699516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:54.705380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:54.705868 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:54.706315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:54.706998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:54.707447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:54.707864 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:54.778508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:54.786631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9099de10-43a4-4c24-acac-b03e880e1988 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1604 microversion: 2.1 time: 0.091520 Sep 28 15:47:54.787193 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 398/800] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:54 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:54.894705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-2cd76b07-ea31-4633-83ca-3a746310abca req-98528a21-92af-455d-bea1-c6ed7838ffd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:54.905581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-2cd76b07-ea31-4633-83ca-3a746310abca req-98528a21-92af-455d-bea1-c6ed7838ffd8 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:54.906120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-2cd76b07-ea31-4633-83ca-3a746310abca req-98528a21-92af-455d-bea1-c6ed7838ffd8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:54.906547 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-2cd76b07-ea31-4633-83ca-3a746310abca req-98528a21-92af-455d-bea1-c6ed7838ffd8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:54.918454 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-2cd76b07-ea31-4633-83ca-3a746310abca req-98528a21-92af-455d-bea1-c6ed7838ffd8 service nova] Creating event network-vif-unplugged:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:47:54.923362 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-2cd76b07-ea31-4633-83ca-3a746310abca req-98528a21-92af-455d-bea1-c6ed7838ffd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032640 Sep 28 15:47:54.923948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 403/801] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:47:55.155953 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:55.157175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:55.163612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.164094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.164531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.165222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.165674 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.166129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.297936 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.306502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.307927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.309127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ae007adb-4e39-4c83-9207-91ffdded1a58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1722 microversion: 2.20 time: 0.157271 Sep 28 15:47:55.309710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 399/802] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:55 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:55.811244 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:55.811945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:55.818621 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.819098 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.819541 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.820236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.820967 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.821097 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.856670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:55.857230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:55.857802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:55.858332 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lazy-loading 'fault' on Instance uuid aa320caa-d879-4630-95ed-d94d1aba1eba {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:47:55.900842 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634c0af05b334b488f2fa358e574172b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62692d2b160040879aecaf4d44ad19b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:55.908739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9ab93026-2ec7-4722-b9fd-0691989621fb tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 200 len: 1327 microversion: 2.1 time: 0.101791 Sep 28 15:47:55.909439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 404/803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:55 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:47:56.335439 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:56.336048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:56.342501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.342980 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.343493 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.344185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.344675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.345104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.477247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:56.485435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:56.487444 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:56.488241 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6c53b1b4-1143-45a7-81ae-e4312b6de70a tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1725 microversion: 2.20 time: 0.157372 Sep 28 15:47:56.488794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 400/804] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:56 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:56.513387 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5578374e-1f6f-4270-9043-6bad041b680f"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:56.515750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:56.521675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.522799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.523231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.523948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.524397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.524815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.797033 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:47:56.807668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-95e39a9f-68c1-4a29-91ff-2b27f412fb79 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298320 Sep 28 15:47:56.808620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 405/805] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Sep 28 15:47:56 2022] POST /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 15:47:56.936421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:56.937019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:56.937135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:56.937298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:56.945171 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.945351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.945705 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.945997 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.946239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.946465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.947215 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.947330 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:56.947670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.947792 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:56.948098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.948211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:56.962935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] HTTP exception thrown: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Request method failure captured: Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba HTTP/1.1 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs1ztkHy0woD6YVEjLMrW9Rl67UFVCCkdSv3Wds7zKSiwCrd_uOfAwktGv6I7u5Os7nv-AYjAfOynwxrEHbg180lJiHhV2ZNZftlspqiKE-NgXssFB46KjBvsRjmSEt84xW_uLB7bEXXl3rCwHVuJ2IXNDlcNp8LmEM2THxoDhaj-4 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:47:56.964870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62692d2b160040879aecaf4d44ad19b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 634c0af05b334b488f2fa358e574172b Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:47:56.966405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': 'aa320caa-d879-4630-95ed-d94d1aba1eba'} Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:47:56.970748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:47:56.972060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:47:56.973198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Returning 404 to user: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:47:56.973198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-37d1ce88-2a7c-4524-9ff4-bd2dc6a12657 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 404 len: 111 microversion: 2.1 time: 0.035498 Sep 28 15:47:56.973198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 401/806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:47:56 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:47:56.975476 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b454861d-07c5-49d6-97b6-6861700769c5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '.version_select at 0x7f1154ea09d0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:56.999360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b454861d-07c5-49d6-97b6-6861700769c5 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527285763" status: 202 len: 0 microversion: 2.1 time: 0.027693 Sep 28 15:47:57.000150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 402/807] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 15:47:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527285763 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:47:57.220666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-49de3a21-ccbf-498a-912e-d5306342a380 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-volume_attachments/5578374e-1f6f-4270-9043-6bad041b680f" status: 202 len: 0 microversion: 2.20 time: 0.288030 Sep 28 15:47:57.221319 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 406/808] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Sep 28 15:47:56 2022] DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-volume_attachments/5578374e-1f6f-4270-9043-6bad041b680f => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:47:57.283801 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:47:57.284529 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:57.291218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:57.291804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:57.292341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:57.293093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:57.293731 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:57.294252 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:57.325280 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127073) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 15:47:57.398303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-94662226-aaf2-47a9-a2ab-6c74f91b9060 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "POST /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/action" status: 202 len: 0 microversion: 2.20 time: 0.118876 Sep 28 15:47:57.399059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 403/809] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 15:47:57 2022] POST /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:47:57.411508 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:57.412120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:57.418653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:57.419141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:57.419577 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:57.420269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:57.420935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:57.421355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:57.578433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:57.587772 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:57.589236 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:57.590629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2d9f000d-945b-4032-9c57-ed5b77b85cce tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1673 microversion: 2.20 time: 0.183450 Sep 28 15:47:57.591176 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 407/810] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:57 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:58.619327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:58.619941 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:58.625920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:58.626406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:58.626841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:58.627531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:58.628023 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:58.628450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:58.771106 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:58.779071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:58.780494 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:58.781641 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-80ad00af-d1c1-46b4-b9ce-698620c605aa tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1673 microversion: 2.20 time: 0.167636 Sep 28 15:47:58.782220 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 404/811] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:58 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:47:59.807105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:47:59.807810 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:47:59.814979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:59.815507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:59.816118 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:59.816903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:47:59.817351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:47:59.818046 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:47:59.951647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:59.959677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:59.961041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:47:59.962210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-541399e2-ce35-43ab-b3c8-35007661d8d2 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1673 microversion: 2.20 time: 0.159007 Sep 28 15:47:59.962767 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 408/812] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:47:59 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:00.987159 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:00.987790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:00.990718 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:00.996460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:00.996946 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:00.997386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:00.998123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:00.998583 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:00.999007 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:01.208047 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:01.208581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:01.217258 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:01.217258 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:01.217635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:01.218359 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:01.218806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:01.220020 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:01.246373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c484ea4f-c4ee-4bea-b8ad-a554d4fc41f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/ips" status: 200 len: 150 microversion: 2.1 time: 0.042289 Sep 28 15:48:01.254158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 409/813] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:48:01 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:01.352969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:01.361243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:01.362690 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:01.363897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-538926f6-a1c9-4729-9d11-f84a88e3c70d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.380790 Sep 28 15:48:01.364443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 405/814] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:00 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:02.392158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:02.392800 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:02.400037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:02.400769 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:02.401367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:02.402087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:02.402692 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:02.403263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:02.566365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:02.575808 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:02.577264 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:02.578480 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f486c0d3-10ea-461d-8db9-e716739d7bc9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.191107 Sep 28 15:48:02.598654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 410/815] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:02 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:02.786096 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "371a4cab-91d5-4dde-9b57-13fa762b1edc"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:02.790078 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:02.797450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:02.798497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:02.800141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:02.801197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:02.801927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:02.802706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:02.895215 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:03.195789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:03.196287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:03.202280 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:03.202809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:03.203239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.203934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:03.204385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:03.204802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.221377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] HTTP exception thrown: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Request method failure captured: Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba HTTP/1.1 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs1ztkHy0woD6YVEjLMrW9Rl67UFVCCkdSv3Wds7zKSiwCrd_uOfAwktGv6I7u5Os7nv-AYjAfOynwxrEHbg180lJiHhV2ZNZftlspqiKE-NgXssFB46KjBvsRjmSEt84xW_uLB7bEXXl3rCwHVuJ2IXNDlcNp8LmEM2THxoDhaj-4 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:03.223094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62692d2b160040879aecaf4d44ad19b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 634c0af05b334b488f2fa358e574172b Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.225206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'aa320caa-d879-4630-95ed-d94d1aba1eba'} Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:03.226141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.227488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.228947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Returning 404 to user: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:03.228947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c2fbb68a-0c0a-4ebe-9f3e-184a001d095b tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 404 len: 111 microversion: 2.1 time: 0.033883 Sep 28 15:48:03.228947 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 411/816] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:03 2022] DELETE /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:48:03.234238 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:03.234847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: aa320caa-d879-4630-95ed-d94d1aba1eba] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:03.241281 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:03.241765 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:03.242227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.243109 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:03.243567 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:03.243986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.258374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] HTTP exception thrown: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Request method failure captured: Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba HTTP/1.1 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs1ztkHy0woD6YVEjLMrW9Rl67UFVCCkdSv3Wds7zKSiwCrd_uOfAwktGv6I7u5Os7nv-AYjAfOynwxrEHbg180lJiHhV2ZNZftlspqiKE-NgXssFB46KjBvsRjmSEt84xW_uLB7bEXXl3rCwHVuJ2IXNDlcNp8LmEM2THxoDhaj-4 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:03.260077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62692d2b160040879aecaf4d44ad19b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 634c0af05b334b488f2fa358e574172b Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.261716 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'aa320caa-d879-4630-95ed-d94d1aba1eba'} Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:03.262924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. Sep 28 15:48:03.264242 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:03.265315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Returning 404 to user: Instance aa320caa-d879-4630-95ed-d94d1aba1eba could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:03.265315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-17ca3a74-cdce-4f3f-882a-a48cec50d4ea tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba" status: 404 len: 111 microversion: 2.1 time: 0.031111 Sep 28 15:48:03.265315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 412/817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:03 2022] GET /compute/v2.1/servers/aa320caa-d879-4630-95ed-d94d1aba1eba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:03.607134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:03.607826 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:03.614446 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:03.615709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:03.616142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.616841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:03.617288 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:03.617709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:03.759283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:03.767905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:03.769330 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:03.770601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8c459b40-dcb5-4894-8e88-90f69c4bde58 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.167383 Sep 28 15:48:03.771214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 413/818] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:03 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:04.422495 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:04.422995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:04.429637 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.430151 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.430586 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.431279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.431732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.432154 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.446218 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] HTTP exception thrown: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Request method failure captured: Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 HTTP/1.1 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs1ztkHy0woD6YVEjLMrW9Rl67UFVCCkdSv3Wds7zKSiwCrd_uOfAwktGv6I7u5Os7nv-AYjAfOynwxrEHbg180lJiHhV2ZNZftlspqiKE-NgXssFB46KjBvsRjmSEt84xW_uLB7bEXXl3rCwHVuJ2IXNDlcNp8LmEM2THxoDhaj-4 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:04.447789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62692d2b160040879aecaf4d44ad19b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 634c0af05b334b488f2fa358e574172b Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.449396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '8ac91576-c5d2-418a-a1c5-af43fccf4e46'} Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:04.450410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.451684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.453553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Returning 404 to user: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:04.453553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-01404dbf-efd6-4670-a812-17cef682f3c7 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 404 len: 111 microversion: 2.1 time: 0.030582 Sep 28 15:48:04.453553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 414/819] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:04 2022] DELETE /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 15:48:04.459564 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:04.460401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] [instance: 8ac91576-c5d2-418a-a1c5-af43fccf4e46] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:04.468029 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.468999 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.469650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.470590 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.471155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.471662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.486160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] HTTP exception thrown: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Request method failure captured: Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 HTTP/1.1 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs1ztkHy0woD6YVEjLMrW9Rl67UFVCCkdSv3Wds7zKSiwCrd_uOfAwktGv6I7u5Os7nv-AYjAfOynwxrEHbg180lJiHhV2ZNZftlspqiKE-NgXssFB46KjBvsRjmSEt84xW_uLB7bEXXl3rCwHVuJ2IXNDlcNp8LmEM2THxoDhaj-4 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:04.487709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62692d2b160040879aecaf4d44ad19b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62692d2b160040879aecaf4d44ad19b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 62692d2b160040879aecaf4d44ad19b3 Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeTestJSON-668844500 Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 634c0af05b334b488f2fa358e574172b Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeTestJSON-668844500-project Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.489271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '8ac91576-c5d2-418a-a1c5-af43fccf4e46'} Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:04.490975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. Sep 28 15:48:04.492397 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:04.493721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] Returning 404 to user: Instance 8ac91576-c5d2-418a-a1c5-af43fccf4e46 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:04.493721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9e758a5a-bc87-4a40-87d0-86f1c41f4576 tempest-AttachVolumeTestJSON-668844500 tempest-AttachVolumeTestJSON-668844500-project] 10.222.0.52 "GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46" status: 404 len: 111 microversion: 2.1 time: 0.034212 Sep 28 15:48:04.493721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 415/820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:04 2022] GET /compute/v2.1/servers/8ac91576-c5d2-418a-a1c5-af43fccf4e46 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:04.797064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:04.797687 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:04.805255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.806039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.806484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.807194 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:04.807827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:04.808256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:04.966528 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:04.982891 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:04.984712 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:04.986196 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-be89aa3d-96ef-4005-be2f-54d95f31b95b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.193233 Sep 28 15:48:04.986866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 416/821] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:04 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:06.012731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:06.014060 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:06.021095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:06.022435 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:06.022864 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:06.023565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:06.024170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:06.024744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:06.247212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:06.256249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:06.257673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:06.258845 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-82301a9c-84ae-443c-a7d1-0098fa89de49 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.250035 Sep 28 15:48:06.259580 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 417/822] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:06 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:07.284635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:07.285953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:07.293496 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:07.294251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:07.294850 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:07.295728 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:07.296445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:07.297031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:07.453939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:07.481819 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:07.483601 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:07.484983 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-eef1cd27-ce4c-4e0f-b851-7fc1bcb82b94 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.204317 Sep 28 15:48:07.501880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 418/823] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:07 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:08.512635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:08.513483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:08.535699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.536210 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.537125 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.537872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:08.539096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:08.540096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:08.801293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:08.813698 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:08.819538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:08.820801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bc6b2363-58ef-479f-a60d-c4a5274ce578 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.311989 Sep 28 15:48:08.821348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 419/824] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:08 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:09.847245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:09.847927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:09.854175 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:09.858122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:09.858622 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:09.859635 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:09.859795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:09.860219 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:10.014470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.022544 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.024028 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:10.025189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4881a82b-7f1a-4809-8830-5cca004c5b14 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.182551 Sep 28 15:48:10.025745 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 420/825] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:09 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:11.008037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-424d0748-03b6-4e9f-80be-fcde12bcf99e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "POST /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.228711 Sep 28 15:48:11.008974 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 406/826] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:48:02 2022] POST /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments => generated 194 bytes in 8231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:11.051849 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:11.053412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:11.062623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.063354 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.063962 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.064840 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:11.065722 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:11.066419 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:11.235836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.245345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.246802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:11.247958 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-de7ea679-b092-4bfc-a2f5-89b48c773771 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.201737 Sep 28 15:48:11.248520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 421/827] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:11 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:12.279049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:12.280460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:12.287586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.288077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.288708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.289596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:12.290082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:12.290711 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:12.438343 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.448242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.449928 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:12.451102 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a412c3f3-02ee-4521-aeea-aff0942143bf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.180093 Sep 28 15:48:12.451647 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 407/828] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:12 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:13.481008 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:13.482209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:13.484794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=64 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:13.491198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:13.491674 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:13.492145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:13.492838 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:13.493605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:13.494123 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:13.650963 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:13.653388 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=92,nova_cell1:INSERT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:13.661209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:13.663456 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:13.664815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-53eb0f75-9f75-4c10-820a-490ae2e8f4ee tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.190591 Sep 28 15:48:13.665555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 422/829] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:13 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:14.702400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:14.703499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:14.722831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.729758 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.730604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.731565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.732189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.732442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.876657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-4aa05333-5ed7-4f6a-88c3-23385328acbb req-652df03d-de51-454b-9932-8b7ba845123b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "name": "network-vif-plugged", "status": "completed", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:14.894483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-4aa05333-5ed7-4f6a-88c3-23385328acbb req-652df03d-de51-454b-9932-8b7ba845123b service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:14.894967 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-4aa05333-5ed7-4f6a-88c3-23385328acbb req-652df03d-de51-454b-9932-8b7ba845123b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:14.899065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.902528 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-4aa05333-5ed7-4f6a-88c3-23385328acbb req-652df03d-de51-454b-9932-8b7ba845123b service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:14.910723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.917103 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:14.927913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-4aa05333-5ed7-4f6a-88c3-23385328acbb req-652df03d-de51-454b-9932-8b7ba845123b service nova] Creating event network-vif-plugged:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:48:14.930469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-451a19c6-2318-4827-9ade-5ef3dd388aae tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.229172 Sep 28 15:48:14.931555 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 408/830] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:14 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:14.948448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-4aa05333-5ed7-4f6a-88c3-23385328acbb req-652df03d-de51-454b-9932-8b7ba845123b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079911 Sep 28 15:48:14.949429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 423/831] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:15.956417 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:15.956943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:15.963416 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.963892 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.964319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:15.964998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:15.965443 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:15.965877 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:16.092421 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.100847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.102282 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:16.103457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b7ce34d7-3f97-41cd-a9c3-117e5524223b tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.151003 Sep 28 15:48:16.104001 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 409/832] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:15 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:17.131174 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:17.131955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:17.138227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.138780 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.139346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.140041 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:17.140492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:17.140911 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:17.330574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:17.338793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:17.340274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:17.341458 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-feaa98e1-8b86-45c0-a9dc-6d4963410021 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.215826 Sep 28 15:48:17.342037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 424/833] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:17 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:18.367027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:18.367678 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:18.374152 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:18.374638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:18.375076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:18.375781 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:18.376273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:18.376703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:18.518803 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.527932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.529606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:18.530796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0f53f33e-feba-4fa9-8ee0-c582d475b04d tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.167941 Sep 28 15:48:18.531331 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 410/834] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:18 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:19.555437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:19.556061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:19.569483 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.570008 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.570449 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.571170 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:19.571629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:19.572057 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:19.733713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.742495 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.744040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:19.745276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d4b01f8e-93bc-4d65-8deb-8db4e44308a6 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1731 microversion: 2.20 time: 0.193753 Sep 28 15:48:19.746114 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 425/835] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:19 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:20.770205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:20.770813 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:20.777438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.777948 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.778382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.779093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.779518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.779991 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.868373 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:20.868860 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:20.875463 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.876331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.876425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.877067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:20.877706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:20.878450 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:20.940076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.948389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.949811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:20.951309 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e7057402-2c7f-43ed-bc7e-dc676fe9e682 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1718 microversion: 2.20 time: 0.184653 Sep 28 15:48:20.952309 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 411/836] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:20 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1718 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:20.982169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lazy-loading 'services' on Instance uuid 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:48:21.068032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ae4996f9-e061-477c-b7d0-a69f00a2bac9 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments/371a4cab-91d5-4dde-9b57-13fa762b1edc" status: 202 len: 0 microversion: 2.1 time: 0.203853 Sep 28 15:48:21.068811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 426/837] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:48:20 2022] DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments/371a4cab-91d5-4dde-9b57-13fa762b1edc => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:48:21.078871 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:21.081969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:21.093174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.093903 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.094702 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.095931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:21.096776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:21.097609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:21.133263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bcb4a30d-0fc4-4e73-bd05-140a2c023572 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059144 Sep 28 15:48:21.134092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 412/838] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:48:21 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:22.147054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:22.149556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:22.158292 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.159455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.160385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.161869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.162634 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.163214 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.195248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-06dac0c4-a135-4f1c-90de-0d94cdf02102 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052937 Sep 28 15:48:22.196047 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 427/839] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:48:22 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:48:22.263024 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:22.264184 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:22.270603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.281739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.282493 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.283509 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.284122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.284705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.319528 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:48:22.406373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-50d411d7-d6a4-4281-970a-20f3bf8826df tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 204 len: 0 microversion: 2.1 time: 0.146752 Sep 28 15:48:22.407205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 413/840] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:22 2022] DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:48:22.417204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:22.417817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:22.423918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.424433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.425051 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.425949 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:22.426443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:22.426873 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:22.568192 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:22.578865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bfd4a409-4415-49ab-88b1-aee3ec49bd2a tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1682 microversion: 2.1 time: 0.166463 Sep 28 15:48:22.588233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 428/841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:22 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:23.604516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:23.605379 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:23.611796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:23.612296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:23.612924 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:23.613653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:23.614772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:23.615190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:23.835447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:23.843796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ab3a3c3b-93f4-46dc-b735-cee844740f5f tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1682 microversion: 2.1 time: 0.243635 Sep 28 15:48:23.844365 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 414/842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:23 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1682 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:24.869169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:24.870453 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:24.877802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.878644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.879306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.880731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:24.881375 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:24.882014 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:24.987039 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f22b26ed7a47480e8448175517170172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eacc288ff1c40c8877635b387ffc3bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:24.998985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c8786ae0-2eba-454b-afec-7f3b69ef70a7 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 200 len: 1614 microversion: 2.1 time: 0.133320 Sep 28 15:48:25.009479 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 429/843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:24 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 1614 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:25.115242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-5bf44c61-dbea-4df8-923b-17feeee89868 req-d61928b9-bc28-43fc-8dce-1925daec6e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e1d44bc-cd43-48ca-83f5-51d4a5635c8d", "name": "network-vif-deleted", "tag": "67ca7698-c1f0-4995-8fbd-1baf4a653918"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:25.146313 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-5bf44c61-dbea-4df8-923b-17feeee89868 req-d61928b9-bc28-43fc-8dce-1925daec6e20 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:25.146796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-5bf44c61-dbea-4df8-923b-17feeee89868 req-d61928b9-bc28-43fc-8dce-1925daec6e20 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:25.150060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-5bf44c61-dbea-4df8-923b-17feeee89868 req-d61928b9-bc28-43fc-8dce-1925daec6e20 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:25.164242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-5bf44c61-dbea-4df8-923b-17feeee89868 req-d61928b9-bc28-43fc-8dce-1925daec6e20 service nova] Creating event network-vif-deleted:67ca7698-c1f0-4995-8fbd-1baf4a653918 for instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d on hv-cinder-85931 Sep 28 15:48:25.175987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-5bf44c61-dbea-4df8-923b-17feeee89868 req-d61928b9-bc28-43fc-8dce-1925daec6e20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067480 Sep 28 15:48:25.183658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 415/844] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:26.023901 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:26.025351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:26.033134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.033966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.034648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.035732 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:26.036704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:26.037464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:26.055898 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d HTTP/1.1 Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:26.058010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:26.059673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '2e1d44bc-cd43-48ca-83f5-51d4a5635c8d'} Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:26.060443 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:26.061710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:26.064338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:26.065296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9cc35990-c68f-4016-93ac-e7b74751a34e tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 404 len: 111 microversion: 2.1 time: 0.046762 Sep 28 15:48:26.066295 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 430/845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:26 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:26.077060 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d5ef65ce-aed1-44b3-b034-c2d89a85c2cb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '.version_select at 0x7f1154e8daf0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:26.105692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d5ef65ce-aed1-44b3-b034-c2d89a85c2cb tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879613123" status: 202 len: 0 microversion: 2.1 time: 0.034320 Sep 28 15:48:26.106627 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 416/846] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 15:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879613123 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:48:28.611657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:28.618447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:28.625314 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.626233 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.626862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.627836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.628393 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.628917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.644447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d HTTP/1.1 Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:28.646471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.648104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '2e1d44bc-cd43-48ca-83f5-51d4a5635c8d'} Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:28.648990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.652747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.661616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:28.661616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5b0ff66f-00ab-4f91-bc0c-4ebc911671b8 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 404 len: 111 microversion: 2.1 time: 0.046335 Sep 28 15:48:28.661616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 431/847] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:28 2022] DELETE /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:28.671037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:28.671037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:28.689645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.690197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.690636 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.692312 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:28.693177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:28.693812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:28.728090 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d HTTP/1.1 Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:48:28.730254 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.731895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '2e1d44bc-cd43-48ca-83f5-51d4a5635c8d'} Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:28.732670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. Sep 28 15:48:28.733899 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:28.735075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 2e1d44bc-cd43-48ca-83f5-51d4a5635c8d could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:28.735075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2c824b00-d56f-4246-97e3-698ecede15ad tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d" status: 404 len: 111 microversion: 2.1 time: 0.074531 Sep 28 15:48:28.735075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 417/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:28 2022] GET /compute/v2.1/servers/2e1d44bc-cd43-48ca-83f5-51d4a5635c8d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:29.943599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:29.944768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:29.953207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:29.953988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:29.954600 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.955382 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:29.955849 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:29.956279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:29.974213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 HTTP/1.1 Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:29.975814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:29.978127 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'a90517e8-f8ed-480c-9005-afe1f77323e8'} Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:29.982190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:29.983623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:29.984868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:29.984868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-800089ec-3a03-4216-93e3-6b6bd8f9cb24 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 404 len: 111 microversion: 2.1 time: 0.039635 Sep 28 15:48:29.984868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 432/849] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:29 2022] DELETE /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:29.993290 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:29.994084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: a90517e8-f8ed-480c-9005-afe1f77323e8] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:30.001335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.002180 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.002787 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.005820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.006745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.008484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.028288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 HTTP/1.1 Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:48:30.031530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:30.033047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': 'a90517e8-f8ed-480c-9005-afe1f77323e8'} Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:30.033833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. Sep 28 15:48:30.036179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.037574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance a90517e8-f8ed-480c-9005-afe1f77323e8 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:30.037574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-28b4e8ef-99fd-40d4-9647-d00d32f5a3d3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8" status: 404 len: 111 microversion: 2.1 time: 0.050171 Sep 28 15:48:30.037574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 418/850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:29 2022] GET /compute/v2.1/servers/a90517e8-f8ed-480c-9005-afe1f77323e8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:30.043032 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:30.043537 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:30.049653 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.051574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.052425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.053334 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.054187 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.054762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.071744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 HTTP/1.1 Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:30.073715 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.075389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '67dc05ad-5958-4041-9643-9646838091a5'} Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:30.076796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.078626 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.080275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:30.080275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cabfa47a-e32e-467a-8e3a-b50edaafa505 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 404 len: 111 microversion: 2.1 time: 0.036267 Sep 28 15:48:30.080275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 433/851] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:30 2022] DELETE /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:30.087839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:30.088532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 67dc05ad-5958-4041-9643-9646838091a5] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:30.095541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.095961 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.096398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.097119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:30.097574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:30.098045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:30.115145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 HTTP/1.1 Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:48:30.116669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.118467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '67dc05ad-5958-4041-9643-9646838091a5'} Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:30.119308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. Sep 28 15:48:30.121691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:30.124767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 67dc05ad-5958-4041-9643-9646838091a5 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:30.124767 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6bc01980-2da8-492a-83d4-83f3c904eaa3 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5" status: 404 len: 111 microversion: 2.1 time: 0.041110 Sep 28 15:48:30.125448 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 419/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:30 2022] GET /compute/v2.1/servers/67dc05ad-5958-4041-9643-9646838091a5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:31.342413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:31.342939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:31.358806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.359297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.359746 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.360434 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.360942 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.361306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.378415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 HTTP/1.1 Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:31.380915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.382543 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '38cb3a9e-72d1-4502-90fe-35576e05e0a2'} Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:31.383557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.385048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.387251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:31.388274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-671d5cd3-cc48-41d5-bf61-7380ad052599 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 404 len: 111 microversion: 2.1 time: 0.049745 Sep 28 15:48:31.389023 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 434/853] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:48:31 2022] DELETE /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:31.402195 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:31.404065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] [instance: 38cb3a9e-72d1-4502-90fe-35576e05e0a2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:31.411841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:31.416553 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.417069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.418143 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.419057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:31.420150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:31.420610 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:31.442483 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] HTTP exception thrown: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Request method failure captured: Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 HTTP/1.1 Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGsvnujM-KOAxkUK6Ek5-io0idyKA7W1JjNl4wK_H063BDsZoEe9cd6buBh3TdRsKKK5XQS5ypIdQaP3G2d-OISB8ZqdqfYp0bDZSTuodGTHnTEgYWFGevwgQxRBLjFkHNJB3WZ5sJT_iRwDGglW8vH3tB6EpxaKjY7oKxrBqfZ3kPg Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:48:31.444116 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eacc288ff1c40c8877635b387ffc3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eacc288ff1c40c8877635b387ffc3bc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 4eacc288ff1c40c8877635b387ffc3bc Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-780220516 Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: f22b26ed7a47480e8448175517170172 Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeNegativeTest-780220516-project Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.445471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '38cb3a9e-72d1-4502-90fe-35576e05e0a2'} Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:31.446267 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. Sep 28 15:48:31.447653 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:31.448786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] Returning 404 to user: Instance 38cb3a9e-72d1-4502-90fe-35576e05e0a2 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:31.448786 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9fae3e78-1f84-495c-8bab-23934c95e7f5 tempest-AttachVolumeNegativeTest-780220516 tempest-AttachVolumeNegativeTest-780220516-project] 10.222.0.52 "GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2" status: 404 len: 111 microversion: 2.1 time: 0.050196 Sep 28 15:48:31.451075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 420/854] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:31 2022] GET /compute/v2.1/servers/38cb3a9e-72d1-4502-90fe-35576e05e0a2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:37.351077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bce257fa-9881-472b-b863-71dccbaee33a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Action: 'create', calling method: .version_select at 0x7f1154dfd5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-190392309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZd3jU3MWew39VsVQFcusjnDjfmGuHlp1l17K9Al8B9N/U0n/EgKfHAUCTaxrDlWiWfkCx1LkGZRrWaA0e9mKMRzhZDZy9ZwTxNGaXz/zpqkTRkOCtxy1tA4FohZl6qFw=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:37.369690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-bce257fa-9881-472b-b863-71dccbaee33a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Getting quotas for project ed1bf756bfcb4d52bd82979559f03a20. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:48:37.374802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-bce257fa-9881-472b-b863-71dccbaee33a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Getting quotas for user 55a6ab5102034cc68a60218d0d434f25 and project ed1bf756bfcb4d52bd82979559f03a20. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:48:37.399084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bce257fa-9881-472b-b863-71dccbaee33a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.304288 Sep 28 15:48:37.399768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 435/855] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:48:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:38.794285 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-04f706b3-09aa-4ede-9e99-8013fdb3236e tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Action: 'create', calling method: .version_select at 0x7f1154e365e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1757649301"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:39.168290 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-04f706b3-09aa-4ede-9e99-8013fdb3236e tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.514191 Sep 28 15:48:39.169303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 421/856] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Sep 28 15:48:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 516 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 15:48:39.185066 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5f5936bb-1ee9-4b7d-ae12-09afba8895d3 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154d4e0d0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:39.245053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5f5936bb-1ee9-4b7d-ae12-09afba8895d3 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 200 len: 345 microversion: 2.1 time: 0.064572 Sep 28 15:48:39.245053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 436/857] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:48:39 2022] GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:40.259667 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b60550ca-f680-431e-aaf1-7c7dc4f1d0f2 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f11587fee50>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.312839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b60550ca-f680-431e-aaf1-7c7dc4f1d0f2 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 200 len: 346 microversion: 2.1 time: 0.057504 Sep 28 15:48:40.313790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 422/858] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:40.329414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f6b2d637-b11d-4129-80b8-52c2a5acee1f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Action: 'create', calling method: .version_select at 0x7f1154d4e820>, body: {"snapshot": {"volume_id": "b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1840975929"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:40.545761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f6b2d637-b11d-4129-80b8-52c2a5acee1f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.222381 Sep 28 15:48:40.546383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 437/859] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Sep 28 15:48:40 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:40.558590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2d6435f2-a279-4009-be94-1f4b63748161 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154e36a60>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.595622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2d6435f2-a279-4009-be94-1f4b63748161 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 200 len: 287 microversion: 2.1 time: 0.040786 Sep 28 15:48:40.596200 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 423/860] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:40.607283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c6d7fa8b-8bc7-4535-ab89-437b6dfcda22 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154fbab80>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.639215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c6d7fa8b-8bc7-4535-ab89-437b6dfcda22 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035639 Sep 28 15:48:40.639783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 438/861] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:40.651297 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1cb15186-3256-401c-b422-e9596f652c46 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f11587fec10>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:40.681677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1cb15186-3256-401c-b422-e9596f652c46 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 200 len: 287 microversion: 2.1 time: 0.034422 Sep 28 15:48:40.682320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 424/862] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:40 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:41.692444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:41.696841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-345cdf77-960d-4a4e-8913-4201785257f6 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154d4d280>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:41.726887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-345cdf77-960d-4a4e-8913-4201785257f6 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 200 len: 287 microversion: 2.1 time: 0.036122 Sep 28 15:48:41.727462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 439/863] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:41 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:42.737077 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:42.737769 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:42.742255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cdb56f86-fddc-484f-927e-a87f5a8f8b45 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f11587dd0d0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:42.775030 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cdb56f86-fddc-484f-927e-a87f5a8f8b45 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 200 len: 287 microversion: 2.1 time: 0.039110 Sep 28 15:48:42.775590 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 425/864] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:42 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:43.788591 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f6018346-601d-4f13-a6e0-c3b3c15286cc tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154d75700>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:43.820096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f6018346-601d-4f13-a6e0-c3b3c15286cc tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 200 len: 288 microversion: 2.1 time: 0.036347 Sep 28 15:48:43.820669 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 440/865] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:43 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:43.832772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-efd65b9f-4c65-4513-9909-86ac83254070 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f11587fe3a0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:43.891191 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-efd65b9f-4c65-4513-9909-86ac83254070 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 202 len: 0 microversion: 2.1 time: 0.062970 Sep 28 15:48:43.891760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 426/866] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Sep 28 15:48:43 2022] DELETE /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:48:43.899918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-09ddbec6-3fbf-415a-8d9b-f8567e585b08 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154d4d820>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:43.931498 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-09ddbec6-3fbf-415a-8d9b-f8567e585b08 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 200 len: 287 microversion: 2.1 time: 0.035296 Sep 28 15:48:43.932062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 441/867] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:43 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:44.945599 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-574d0eb4-971a-49e2-9e25-8a8df66a6d9f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f11587ddaf0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:44.972517 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-574d0eb4-971a-49e2-9e25-8a8df66a6d9f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] HTTP exception thrown: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-574d0eb4-971a-49e2-9e25-8a8df66a6d9f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Request method failure captured: Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 HTTP/1.1 Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGzWBCBtJn8fEDau7yIlKhdUqRkSFB0EdC3vQ9lhKqBXBVf6hBHDWNmb5nZ6T4SqjxZyHKXUfNpyB9TaHf9vePbJPBl3u7z3zFl5Ux6fhU_MAnJUzexn8rvqpxlu2ENdxT7HzfU_1ZsIyJbdJHH0FwQXYURstuZeMVbcjfJ1muYV5Pw Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:48:44.974753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10a3c501ae9a4ea5a317c580568a0210", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 7986c65b8b494ff581c9526ff6cea016 Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '5e89f0da-f644-45bb-9b7e-bc806ba4b742'} Sep 28 15:48:44.976432 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. (HTTP 404) (Request-ID: req-b96578d7-df8c-4e57-a080-07382ab41585) Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.977499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:48:44.979176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 28 15:48:44.980620 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-574d0eb4-971a-49e2-9e25-8a8df66a6d9f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Returning 404 to user: Snapshot 5e89f0da-f644-45bb-9b7e-bc806ba4b742 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:44.982158 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-574d0eb4-971a-49e2-9e25-8a8df66a6d9f tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742" status: 404 len: 111 microversion: 2.1 time: 0.035551 Sep 28 15:48:44.983210 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 427/868] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:48:44 2022] GET /compute/v2.1/os-snapshots/5e89f0da-f644-45bb-9b7e-bc806ba4b742 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:44.985145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4155a38c-0f68-4b2d-80df-d4e58b9721b3 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154e6b3a0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:45.060924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4155a38c-0f68-4b2d-80df-d4e58b9721b3 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 202 len: 0 microversion: 2.1 time: 0.079930 Sep 28 15:48:45.061584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 442/869] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:48:44 2022] DELETE /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:48:45.071319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-12a15e65-f793-42e8-a8a4-f01dcd594f80 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154f4ae50>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:45.119832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-12a15e65-f793-42e8-a8a4-f01dcd594f80 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 200 len: 345 microversion: 2.1 time: 0.052741 Sep 28 15:48:45.120405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 428/870] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:48:45 2022] GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:46.135162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa312221-2ef1-4b66-970f-5442586ec1a9 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154f973a0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:46.166206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-fa312221-2ef1-4b66-970f-5442586ec1a9 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] HTTP exception thrown: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa312221-2ef1-4b66-970f-5442586ec1a9 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Request method failure captured: Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 HTTP/1.1 Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGzWBCBtJn8fEDau7yIlKhdUqRkSFB0EdC3vQ9lhKqBXBVf6hBHDWNmb5nZ6T4SqjxZyHKXUfNpyB9TaHf9vePbJPBl3u7z3zFl5Ux6fhU_MAnJUzexn8rvqpxlu2ENdxT7HzfU_1ZsIyJbdJHH0FwQXYURstuZeMVbcjfJ1muYV5Pw Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:46.168472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10a3c501ae9a4ea5a317c580568a0210", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 7986c65b8b494ff581c9526ff6cea016 Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11'} Sep 28 15:48:46.170478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. (HTTP 404) (Request-ID: req-5e1cec53-db8f-40f2-a4f8-4f8b4c2ff9a6) Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.171441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:48:46.172934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:48:46.174378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa312221-2ef1-4b66-970f-5442586ec1a9 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Returning 404 to user: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa312221-2ef1-4b66-970f-5442586ec1a9 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 404 len: 109 microversion: 2.1 time: 0.039429 Sep 28 15:48:46.175790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 443/871] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:48:46 2022] GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:46.185987 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f721ee5-86cb-4775-90b1-43ce8a2b8546 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f11587fe0d0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:46.214622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-4f721ee5-86cb-4775-90b1-43ce8a2b8546 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] HTTP exception thrown: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f721ee5-86cb-4775-90b1-43ce8a2b8546 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Request method failure captured: Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: DELETE /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 HTTP/1.1 Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGzWBCBtJn8fEDau7yIlKhdUqRkSFB0EdC3vQ9lhKqBXBVf6hBHDWNmb5nZ6T4SqjxZyHKXUfNpyB9TaHf9vePbJPBl3u7z3zFl5Ux6fhU_MAnJUzexn8rvqpxlu2ENdxT7HzfU_1ZsIyJbdJHH0FwQXYURstuZeMVbcjfJ1muYV5Pw Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:48:46.216514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10a3c501ae9a4ea5a317c580568a0210", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 7986c65b8b494ff581c9526ff6cea016 Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': 'b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11'} Sep 28 15:48:46.218194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. (HTTP 404) (Request-ID: req-4e2087c2-0d99-4430-804c-11750ed182b0) Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.219185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 15:48:46.220693 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 15:48:46.222333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f721ee5-86cb-4775-90b1-43ce8a2b8546 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Returning 404 to user: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4f721ee5-86cb-4775-90b1-43ce8a2b8546 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 404 len: 109 microversion: 2.1 time: 0.036755 Sep 28 15:48:46.224450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 429/872] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:48:46 2022] DELETE /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:46.228794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-59640eae-f050-48c6-8505-ec9775acc910 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Calling method '.version_select at 0x7f1154f43310>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:46.263084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-59640eae-f050-48c6-8505-ec9775acc910 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] HTTP exception thrown: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-59640eae-f050-48c6-8505-ec9775acc910 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Request method failure captured: Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 HTTP/1.1 Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGzWBCBtJn8fEDau7yIlKhdUqRkSFB0EdC3vQ9lhKqBXBVf6hBHDWNmb5nZ6T4SqjxZyHKXUfNpyB9TaHf9vePbJPBl3u7z3zFl5Ux6fhU_MAnJUzexn8rvqpxlu2ENdxT7HzfU_1ZsIyJbdJHH0FwQXYURstuZeMVbcjfJ1muYV5Pw Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:46.265441 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/10a3c501ae9a4ea5a317c580568a0210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_10a3c501ae9a4ea5a317c580568a0210", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 10a3c501ae9a4ea5a317c580568a0210 Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2056657422 Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 7986c65b8b494ff581c9526ff6cea016 Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2056657422-project Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11'} Sep 28 15:48:46.267239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. (HTTP 404) (Request-ID: req-370d946b-bd20-40ea-b994-52da848a5cb1) Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.268533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:48:46.270085 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:48:46.272081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-59640eae-f050-48c6-8505-ec9775acc910 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] Returning 404 to user: Volume b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-59640eae-f050-48c6-8505-ec9775acc910 tempest-VolumesSnapshotsTestJSON-2056657422 tempest-VolumesSnapshotsTestJSON-2056657422-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11" status: 404 len: 109 microversion: 2.1 time: 0.043425 Sep 28 15:48:46.273464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 444/873] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:48:46 2022] GET /compute/v2.1/os-volumes/b7254b9f-16e2-4d6c-bc9f-e6ed383b7f11 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:48:54.674315 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:54.676492 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:54.682687 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:54.683172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:54.683612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:54.684320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:54.684776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:54.685206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:54.715040 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-38599f10-4a46-47cb-a8af-079a2b116dba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046439 Sep 28 15:48:54.715787 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 430/874] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 15:48:54 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:54.783807 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:54.785152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:54.787672 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=4 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:54.788325 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:48:54.801172 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:54.801975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:54.802323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:54.803201 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:54.803866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:54.804821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:54.832452 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:48:54.916064 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-96398189-4f42-4075-87e3-9729ec8a2095 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 204 len: 0 microversion: 2.20 time: 0.136659 Sep 28 15:48:54.916646 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 445/875] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 15:48:54 2022] DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 15:48:54.924993 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:54.925684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:54.932387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:54.932862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:54.933283 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:54.934000 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:54.934454 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:54.934878 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:55.071127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:55.079226 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:55.080857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:55.082064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4a34d7bd-1a42-4a5b-b5c9-d6d9271fc5d1 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.160940 Sep 28 15:48:55.083248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 431/876] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:54 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:56.110965 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:56.111657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:56.119756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:56.120478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:56.120912 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:56.121827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:56.122605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:56.122966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:56.273524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:56.296612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:56.296612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:56.296612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5005267e-3907-4ca3-beac-037570c683c4 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1724 microversion: 2.20 time: 0.182113 Sep 28 15:48:56.297118 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 446/877] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:56 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 15:48:56.307113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1646889020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-190392309", "security_groups": [{"name": "tempest-secgroup-smoke-1748747141"}], "networks": [{"uuid": "075cc0be-5e39-4fb6-a8fe-314feee10098"}], "block_device_mapping_v2": [{"uuid": "fbd27f1b-0b8c-4623-ba6c-74f75034bfe9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:56.527407 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] validate_networks() for [('075cc0be-5e39-4fb6-a8fe-314feee10098', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:48:57.315614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:57.316360 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:57.327220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.328243 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.328824 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.330124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.330660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.331150 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.363202 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:48:57.365251 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:48:57.366064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:48:57.366752 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:48:57.367381 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:48:57.384838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.385490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.386351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.387101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.388463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.389037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.409574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Getting quotas for project ed1bf756bfcb4d52bd82979559f03a20. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:48:57.414726 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Getting quotas for user 55a6ab5102034cc68a60218d0d434f25 and project ed1bf756bfcb4d52bd82979559f03a20. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:48:57.434138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.447352 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.449700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '298dfca23e004969a0c907e18c7237a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335ecfeb5c6a436e909618c1305593bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.451459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6c4a3ec3-2620-41f8-b75a-eb6ecd74aebf tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 200 len: 1656 microversion: 2.20 time: 0.139776 Sep 28 15:48:57.453520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 447/878] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:57 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 1656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 15:48:57.485310 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:48:57.488172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbd27f1b-0b8c-4623-ba6c-74f75034bfe9',volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:48:57.638913 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-94d0501c-0fd7-4245-b439-e0cffbf2007f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.335428 Sep 28 15:48:57.640243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 432/879] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:48:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:48:57.655029 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5ac831ce-ba72-43ae-8618-1c9948d676a2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:57.656869 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5ac831ce-ba72-43ae-8618-1c9948d676a2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:57.727173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-b469e8da-d720-4fb0-a675-5b6a3061f641 req-48716b30-8bf3-4808-8680-0b32dae845ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4", "name": "network-vif-deleted", "tag": "e6c19ccc-4417-4703-b693-5cf72e3030b1"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:48:57.743548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b469e8da-d720-4fb0-a675-5b6a3061f641 req-48716b30-8bf3-4808-8680-0b32dae845ac service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:57.750319 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5ac831ce-ba72-43ae-8618-1c9948d676a2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:57.760176 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b469e8da-d720-4fb0-a675-5b6a3061f641 req-48716b30-8bf3-4808-8680-0b32dae845ac service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:57.761326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5ac831ce-ba72-43ae-8618-1c9948d676a2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1088 microversion: 2.1 time: 0.111551 Sep 28 15:48:57.762212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-b469e8da-d720-4fb0-a675-5b6a3061f641 req-48716b30-8bf3-4808-8680-0b32dae845ac service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:57.765394 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 448/880] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:57 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1088 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:57.795478 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-b469e8da-d720-4fb0-a675-5b6a3061f641 req-48716b30-8bf3-4808-8680-0b32dae845ac service nova] Creating event network-vif-deleted:e6c19ccc-4417-4703-b693-5cf72e3030b1 for instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 on hv-cinder-85931 Sep 28 15:48:57.801284 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-b469e8da-d720-4fb0-a675-5b6a3061f641 req-48716b30-8bf3-4808-8680-0b32dae845ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077878 Sep 28 15:48:57.806039 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 433/881] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:48:58.477344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:58.478799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:58.485928 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.486615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.487055 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.487998 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.488628 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.489052 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.503140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] HTTP exception thrown: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Request method failure captured: Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 HTTP/1.1 Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGs38O9EBIK7hYyEBrEC6ee3MDpnaCDrQkQs5srjncsY9pFBe8pnP2T8AFgQK_iL10cAkdfFVnX_9uwJ4GMaBsYt3Kgd1RO6Mn6oOQycR3HTU_Dv1UcLU3DPKkQZoBsB1biHSUSGeSscljHL9fNuHjKLWjXA43StgHbfSpt7x7YbGSE Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:48:58.505760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_335ecfeb5c6a436e909618c1305593bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 298dfca23e004969a0c907e18c7237a4 Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:48:58.507279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4'} Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:48:58.508068 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:48:58.509366 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:48:58.512136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Returning 404 to user: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:48:58.513215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fdfe3af3-f023-4694-98ec-6d26ed008fb7 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 404 len: 111 microversion: 2.20 time: 0.040185 Sep 28 15:48:58.514166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 449/882] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:48:58 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:48:58.525328 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-997c7313-7f9b-4a96-be51-e0e8f6b5ffef tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '.version_select at 0x7f1154d7aaf0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:58.550115 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-997c7313-7f9b-4a96-be51-e0e8f6b5ffef tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192964095" status: 204 len: 0 microversion: 2.20 time: 0.030342 Sep 28 15:48:58.551606 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 434/883] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Sep 28 15:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192964095 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 15:48:58.790866 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:58.791852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:58.814734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.815459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.816071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.817910 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:58.818783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:58.819510 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:58.910666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:48:58.920115 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3cff0278-2f8b-4a6c-a726-7f7a8526ea6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1186 microversion: 2.1 time: 0.133881 Sep 28 15:48:58.920681 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 450/884] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:58 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1186 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:48:59.950115 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:48:59.950115 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:48:59.958440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:59.958937 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:59.959373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:48:59.960074 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:48:59.960541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:48:59.960952 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:00.039893 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:00.057168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-26ea1dcd-1770-4330-b7d8-09db8d138cb0 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1192 microversion: 2.1 time: 0.116284 Sep 28 15:49:00.057753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 435/885] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:48:59 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:01.083675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:01.084469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:01.092252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.093013 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.093616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.094642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.095259 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.095838 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.186228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:01.187039 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:01.193636 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.194197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.194774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.195509 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.195959 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.196392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.210772 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] HTTP exception thrown: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Request method failure captured: Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 HTTP/1.1 Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs38O9EBIK7hYyEBrEC6ee3MDpnaCDrQkQs5srjncsY9pFBe8pnP2T8AFgQK_iL10cAkdfFVnX_9uwJ4GMaBsYt3Kgd1RO6Mn6oOQycR3HTU_Dv1UcLU3DPKkQZoBsB1biHSUSGeSscljHL9fNuHjKLWjXA43StgHbfSpt7x7YbGSE Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:49:01.212689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_335ecfeb5c6a436e909618c1305593bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 298dfca23e004969a0c907e18c7237a4 Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.214479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4'} Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:49:01.215327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.216649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.220782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Returning 404 to user: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:49:01.220782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5aee2fa8-5662-4a99-8875-58ee4251ac3c tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 404 len: 111 microversion: 2.20 time: 0.032878 Sep 28 15:49:01.220782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 436/886] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 15:49:01 2022] DELETE /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:49:01.231498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:01.232891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:01.241485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.243065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.243678 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.244800 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.245424 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.246289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.289396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] HTTP exception thrown: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Request method failure captured: Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 HTTP/1.1 Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs38O9EBIK7hYyEBrEC6ee3MDpnaCDrQkQs5srjncsY9pFBe8pnP2T8AFgQK_iL10cAkdfFVnX_9uwJ4GMaBsYt3Kgd1RO6Mn6oOQycR3HTU_Dv1UcLU3DPKkQZoBsB1biHSUSGeSscljHL9fNuHjKLWjXA43StgHbfSpt7x7YbGSE Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:49:01.292157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_335ecfeb5c6a436e909618c1305593bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 298dfca23e004969a0c907e18c7237a4 Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.294468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4'} Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:49:01.295326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. Sep 28 15:49:01.298212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:01.300814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Returning 404 to user: Instance 0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:49:01.300814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-db4e546f-8ac9-4f32-984e-152d0f1ac8ba tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4" status: 404 len: 111 microversion: 2.20 time: 0.069041 Sep 28 15:49:01.300814 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 437/887] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:49:01 2022] GET /compute/v2.1/servers/0fb84fe2-3c80-4c35-9e1d-87af2c5c84e4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:49:01.387624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:01.398645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6e6fd455-92ed-4b9d-8648-0f5b94f4185a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.319577 Sep 28 15:49:01.399956 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 451/888] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:01 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:01.466594 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-c3ab015c-69d2-4156-9113-34d19e58a34f req-52521ee8-c560-4470-aa5d-32cf1a965117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:01.480506 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c3ab015c-69d2-4156-9113-34d19e58a34f req-52521ee8-c560-4470-aa5d-32cf1a965117 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:01.481068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c3ab015c-69d2-4156-9113-34d19e58a34f req-52521ee8-c560-4470-aa5d-32cf1a965117 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:01.481533 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c3ab015c-69d2-4156-9113-34d19e58a34f req-52521ee8-c560-4470-aa5d-32cf1a965117 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:01.500150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-c3ab015c-69d2-4156-9113-34d19e58a34f req-52521ee8-c560-4470-aa5d-32cf1a965117 service nova] Creating event network-changed:c78f0be5-1345-49e1-9c04-e28beb7e2fa7 for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 on hv-cinder-85931 Sep 28 15:49:01.508527 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-c3ab015c-69d2-4156-9113-34d19e58a34f req-52521ee8-c560-4470-aa5d-32cf1a965117 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047580 Sep 28 15:49:01.510041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 438/889] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:02.429307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:02.431581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:02.443063 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.443557 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.443990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.444696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.445158 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.445584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.563406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:02.564059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:02.574808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.575301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.575731 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.576431 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.576877 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.577299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.591593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] HTTP exception thrown: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Request method failure captured: Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f HTTP/1.1 Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs38O9EBIK7hYyEBrEC6ee3MDpnaCDrQkQs5srjncsY9pFBe8pnP2T8AFgQK_iL10cAkdfFVnX_9uwJ4GMaBsYt3Kgd1RO6Mn6oOQycR3HTU_Dv1UcLU3DPKkQZoBsB1biHSUSGeSscljHL9fNuHjKLWjXA43StgHbfSpt7x7YbGSE Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:49:02.594108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_335ecfeb5c6a436e909618c1305593bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 298dfca23e004969a0c907e18c7237a4 Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.595819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '44dffde6-94ba-408b-895a-eaaa80ad0b0f'} Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:49:02.596698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.599033 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.602367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Returning 404 to user: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:49:02.603765 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-280619b9-2918-4980-89e5-8e9bba75906f tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 404 len: 111 microversion: 2.20 time: 0.045277 Sep 28 15:49:02.604695 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 439/890] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 15:49:02 2022] DELETE /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 15:49:02.613629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:02.614676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] [instance: 44dffde6-94ba-408b-895a-eaaa80ad0b0f] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:02.622207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.623206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.624003 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.624912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:02.625552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:02.626230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:02.645211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] HTTP exception thrown: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Request method failure captured: Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f HTTP/1.1 Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGs38O9EBIK7hYyEBrEC6ee3MDpnaCDrQkQs5srjncsY9pFBe8pnP2T8AFgQK_iL10cAkdfFVnX_9uwJ4GMaBsYt3Kgd1RO6Mn6oOQycR3HTU_Dv1UcLU3DPKkQZoBsB1biHSUSGeSscljHL9fNuHjKLWjXA43StgHbfSpt7x7YbGSE Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:49:02.647576 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/335ecfeb5c6a436e909618c1305593bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_335ecfeb5c6a436e909618c1305593bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 335ecfeb5c6a436e909618c1305593bb Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1760550550 Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 298dfca23e004969a0c907e18c7237a4 Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1760550550-project Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.649100 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '44dffde6-94ba-408b-895a-eaaa80ad0b0f'} Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:49:02.649891 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. Sep 28 15:49:02.651208 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:49:02.652931 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] Returning 404 to user: Instance 44dffde6-94ba-408b-895a-eaaa80ad0b0f could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:49:02.653754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-54920f65-7bf8-4ec1-bda0-15da1c7c97a9 tempest-AttachVolumeShelveTestJSON-1760550550 tempest-AttachVolumeShelveTestJSON-1760550550-project] 10.222.0.52 "GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f" status: 404 len: 111 microversion: 2.20 time: 0.045012 Sep 28 15:49:02.654657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 440/891] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 15:49:02 2022] GET /compute/v2.1/servers/44dffde6-94ba-408b-895a-eaaa80ad0b0f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 15:49:02.713128 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:02.724674 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f5709346-b851-4b49-a5fe-25423ddcc20c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.304507 Sep 28 15:49:02.729939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 452/892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:02 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:03.758645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:03.760559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:03.772075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:03.772648 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:03.773095 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:03.774718 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:03.775186 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:03.776063 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:03.962431 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:03.972101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a6f3fffb-5327-4235-a49a-10b33157c58d tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.225663 Sep 28 15:49:03.973600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 441/893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:03 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:04.996257 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:04.997011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:05.002838 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:05.003319 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:05.004384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:05.005103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:05.005540 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:05.006078 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:05.158708 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:05.166915 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d45c2177-7813-4564-843f-dfe779154e2c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.174602 Sep 28 15:49:05.167489 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 453/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:04 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:06.190475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:06.191760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:06.198460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:06.199140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:06.199781 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:06.200656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:06.201313 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:06.201924 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:06.444418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:06.455972 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-91e6a7fd-59fa-4573-af0e-19724aa91218 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.269412 Sep 28 15:49:06.457313 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 442/895] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:06 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:07.495701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:07.497181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:07.512415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:07.513205 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:07.513636 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:07.515584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:07.516381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:07.516864 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:07.865437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:08.146685 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:08.157469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8743ae90-537a-4562-9083-ce14f747d3b8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.679934 Sep 28 15:49:08.158079 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 454/896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:07 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:08.580142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:08.583303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:08.813768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a0870401-e50e-4721-9e4b-e54966746c7e tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Action: 'create', calling method: .version_select at 0x7f1154dfd550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1514691329", "metadata": {"Type": "work"}}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:09.190251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:09.190251 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:09.198384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:09.198963 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:09.199488 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:09.200431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:09.202909 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:09.203678 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:09.393884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a0870401-e50e-4721-9e4b-e54966746c7e tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.818641 Sep 28 15:49:09.403327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 443/897] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 15:49:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 829 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 15:49:09.408774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e20241a4-4a64-4d2a-a38d-00950e85896d tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Calling method '.version_select at 0x7f1154e8d940>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:09.521538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:09.527872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e20241a4-4a64-4d2a-a38d-00950e85896d tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48" status: 200 len: 353 microversion: 2.1 time: 0.123172 Sep 28 15:49:09.528682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 444/898] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:49:09 2022] GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:09.541122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-848a4027-b5e4-4224-9828-cc7202462555 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.360995 Sep 28 15:49:09.543590 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 455/899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:09 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:10.545950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9cc861d1-f658-4c1d-b055-72e9f8e0cfcf tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Calling method '.version_select at 0x7f11587dd310>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:10.566827 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:10.567565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:10.580925 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:10.581905 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:10.582946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:10.584001 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:10.586374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:10.587040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:10.599506 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9cc861d1-f658-4c1d-b055-72e9f8e0cfcf tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48" status: 200 len: 354 microversion: 2.1 time: 0.057325 Sep 28 15:49:10.600572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 445/900] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:49:10 2022] GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:10.614191 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-58fe80b0-2754-4507-85a3-f7f5ebe9b122 tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Calling method '.version_select at 0x7f11587fa8b0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:10.712971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-58fe80b0-2754-4507-85a3-f7f5ebe9b122 tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48" status: 200 len: 354 microversion: 2.1 time: 0.103693 Sep 28 15:49:10.725883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 446/901] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:49:10 2022] GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:10.734702 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b39f4ae0-90cb-4dc9-b287-dc6051c4322e tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Calling method '.version_select at 0x7f1154dfd700>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:10.822839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:10.829151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b39f4ae0-90cb-4dc9-b287-dc6051c4322e tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48" status: 202 len: 0 microversion: 2.1 time: 0.098066 Sep 28 15:49:10.829802 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 447/902] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 15:49:10 2022] DELETE /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:49:10.834311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b4fe71e2-9912-4c99-8cd0-f8b10bcb1863 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.272825 Sep 28 15:49:10.834961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 456/903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:10 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:10.838603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-711fcd76-9ddd-4933-a8dc-a7b2d97b383f tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Calling method '.version_select at 0x7f11587feee0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:10.893292 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-711fcd76-9ddd-4933-a8dc-a7b2d97b383f tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48" status: 200 len: 353 microversion: 2.1 time: 0.058715 Sep 28 15:49:10.894164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 448/904] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:49:10 2022] GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:49:11.218382 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-acd11a41-f767-46e3-9ef8-7e375bdaf35b req-da3cda47-c7a1-4b94-a925-7c90e43ff7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "name": "network-vif-plugged", "status": "completed", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:11.228841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-acd11a41-f767-46e3-9ef8-7e375bdaf35b req-da3cda47-c7a1-4b94-a925-7c90e43ff7ea service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:11.229637 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-acd11a41-f767-46e3-9ef8-7e375bdaf35b req-da3cda47-c7a1-4b94-a925-7c90e43ff7ea service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:11.230091 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-acd11a41-f767-46e3-9ef8-7e375bdaf35b req-da3cda47-c7a1-4b94-a925-7c90e43ff7ea service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:11.242377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-acd11a41-f767-46e3-9ef8-7e375bdaf35b req-da3cda47-c7a1-4b94-a925-7c90e43ff7ea service nova] Creating event network-vif-plugged:c78f0be5-1345-49e1-9c04-e28beb7e2fa7 for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 on hv-cinder-85931 Sep 28 15:49:11.249806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-acd11a41-f767-46e3-9ef8-7e375bdaf35b req-da3cda47-c7a1-4b94-a925-7c90e43ff7ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Sep 28 15:49:11.250527 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 457/905] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:11.860213 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:11.862894 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:11.871007 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:11.872140 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:11.873171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:11.874194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:11.874902 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:11.875654 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:11.909750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8146709-fc45-4d1f-8a2d-13bd11173ecb tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Calling method '.version_select at 0x7f1154d3cc10>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:11.964648 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-a8146709-fc45-4d1f-8a2d-13bd11173ecb tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] HTTP exception thrown: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8146709-fc45-4d1f-8a2d-13bd11173ecb tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Request method failure captured: Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 HTTP/1.1 Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGz0yHpKgQyrmwQIT8RxsswxAjrl5pNwy0tMngYqh840bgnnlkXykdRCSvy2apEY4g-_TUMsDvV7Sy6OG2lPzP6CvK3BYUAnyIj8HsGFU8UoLLhJEPoafJGtaR_5iqxpLFQmlfGwNTYjHKaol8-bW-kuW-LO4rJ2Q-3I-NFfwOiIhUU Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: ddebfbe211414bca924d40cbf358a020 Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-VolumesGetTestJSON-1994122782 Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:49:11.966791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ddebfbe211414bca924d40cbf358a020"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ddebfbe211414bca924d40cbf358a020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ddebfbe211414bca924d40cbf358a020"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ddebfbe211414bca924d40cbf358a020", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-VolumesGetTestJSON-1994122782 Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: ddebfbe211414bca924d40cbf358a020 Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-VolumesGetTestJSON-1994122782 Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-VolumesGetTestJSON-1994122782-project Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 663e1fee12c54a6f92ffe12d1063d6fe Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-VolumesGetTestJSON-1994122782-project Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': 'f9e45db2-1dc4-4782-9068-c9159c95df48'} Sep 28 15:49:11.968296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. (HTTP 404) (Request-ID: req-8aaf076e-9b40-48da-880f-23528888fad9) Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:11.969230 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 15:49:11.971135 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 15:49:11.972368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8146709-fc45-4d1f-8a2d-13bd11173ecb tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] Returning 404 to user: Volume f9e45db2-1dc4-4782-9068-c9159c95df48 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a8146709-fc45-4d1f-8a2d-13bd11173ecb tempest-VolumesGetTestJSON-1994122782 tempest-VolumesGetTestJSON-1994122782-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48" status: 404 len: 109 microversion: 2.1 time: 0.063478 Sep 28 15:49:11.973645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 458/906] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 15:49:11 2022] GET /compute/v2.1/os-volumes/f9e45db2-1dc4-4782-9068-c9159c95df48 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:49:12.086860 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:12.101719 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-dbf65a88-ba3f-42aa-9bbe-4cb440670e6b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1260 microversion: 2.1 time: 0.246793 Sep 28 15:49:12.103175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 449/907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:11 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:13.136868 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:13.137606 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:13.153329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.156985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.161731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.162784 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.163469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.164124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.481790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:13.496572 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9fe89196-889e-4263-a948-f88920fcead3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1445 microversion: 2.1 time: 0.371061 Sep 28 15:49:13.506940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 459/908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:13 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1445 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:13.519469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:13.520190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:13.527968 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.528723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.529367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.530680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:13.531618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:13.532245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:13.842173 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:13.857197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a335e480-5729-4526-8427-25abcaaf5086 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1445 microversion: 2.1 time: 0.341579 Sep 28 15:49:13.858377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 450/909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:13 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1445 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:18.188610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-6ac179a2-5bb9-4c60-967e-ac3463d6db43 req-240a0a5e-9538-4f2c-8c9c-59a18f914368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:18.200206 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-6ac179a2-5bb9-4c60-967e-ac3463d6db43 req-240a0a5e-9538-4f2c-8c9c-59a18f914368 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:18.200684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-6ac179a2-5bb9-4c60-967e-ac3463d6db43 req-240a0a5e-9538-4f2c-8c9c-59a18f914368 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:18.201213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-6ac179a2-5bb9-4c60-967e-ac3463d6db43 req-240a0a5e-9538-4f2c-8c9c-59a18f914368 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:18.237813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-6ac179a2-5bb9-4c60-967e-ac3463d6db43 req-240a0a5e-9538-4f2c-8c9c-59a18f914368 service nova] Creating event network-changed:c78f0be5-1345-49e1-9c04-e28beb7e2fa7 for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 on hv-cinder-85931 Sep 28 15:49:18.256553 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-6ac179a2-5bb9-4c60-967e-ac3463d6db43 req-240a0a5e-9538-4f2c-8c9c-59a18f914368 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071625 Sep 28 15:49:18.258696 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 460/910] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:34.197393 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:34.198716 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=56 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:34.791194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2a5cc9b3-0d97-4fbf-9194-fef1ea08e22b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Action: 'create', calling method: .version_select at 0x7f11587faf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1866724906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQrjCrWzbHe8kHsrGMazUbXMPUEnOnMEIavsOSLrSqFr1HtRNQQipGRmla6XKMdeSp+xWPNjqw8MHgJopKsYIvZw3plG/ecgGJck5gQu2GGe6NoCUe+drPrB7d98/CBKQ=="}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:34.836596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-2a5cc9b3-0d97-4fbf-9194-fef1ea08e22b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:49:34.850029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-2a5cc9b3-0d97-4fbf-9194-fef1ea08e22b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for user 5fac9ab7665b4f14936adea96ae22ec4 and project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'key_pairs'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:49:34.900414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2a5cc9b3-0d97-4fbf-9194-fef1ea08e22b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.709804 Sep 28 15:49:34.901253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 451/911] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:49:34 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:37.698567 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:37.699753 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:37.703990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-001b848a-78b0-443b-8efb-b47c77f4f2ce tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Action: 'create', calling method: .version_select at 0x7f1154d7dca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-678405601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGh6o+l/joQy2flZsdnq+iCUYgz70HeTjB4sZlaHU/U+qr3ziZUAN+WKP5FdMQvsjdfuIwGQOax4CzpKF/2/fgAcDrfe2y+XR38EtGB9cCga5IXQtXfI+hrbmHp5elsow=="}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:37.723973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-001b848a-78b0-443b-8efb-b47c77f4f2ce tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Getting quotas for project 069626c3525d47a9b67f1e6d81b47b2a. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:49:37.729207 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-001b848a-78b0-443b-8efb-b47c77f4f2ce tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Getting quotas for user a7a959e57e0c4713a855844645fdc26a and project 069626c3525d47a9b67f1e6d81b47b2a. Resources: {'key_pairs'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:49:37.752790 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-001b848a-78b0-443b-8efb-b47c77f4f2ce tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055638 Sep 28 15:49:37.754503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 461/912] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 15:49:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:37.863461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2022904988", "imageRef": "f13380bc-3ca1-40b1-bdfd-0860a4babfee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-678405601", "networks": [{"uuid": "bcc7c8e5-217b-472a-b2a7-f672fbc784d2"}]}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:37.922139 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] validate_networks() for [('bcc7c8e5-217b-472a-b2a7-f672fbc784d2', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:49:38.370063 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:49:38.370647 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:49:38.371118 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:49:38.371518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:49:38.371919 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:49:38.380852 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:38.381357 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:38.381812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:38.383068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:38.383196 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:38.383636 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:38.403125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Getting quotas for project 069626c3525d47a9b67f1e6d81b47b2a. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:49:38.408433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Getting quotas for user a7a959e57e0c4713a855844645fdc26a and project 069626c3525d47a9b67f1e6d81b47b2a. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:49:38.433172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:49:38.435508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f13380bc-3ca1-40b1-bdfd-0860a4babfee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:49:38.497675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4bd8334f-3d78-4113-9315-19a958f6ef4f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639080 Sep 28 15:49:38.499092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 452/913] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:49:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:49:38.510693 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8e8cc530-f272-4bd6-a44d-0044f97a5240 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:38.511525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8e8cc530-f272-4bd6-a44d-0044f97a5240 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:38.642220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8e8cc530-f272-4bd6-a44d-0044f97a5240 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:38.659533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8e8cc530-f272-4bd6-a44d-0044f97a5240 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1258 microversion: 2.1 time: 0.152971 Sep 28 15:49:38.662149 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 462/914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:38 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:39.685216 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:39.685836 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:39.692558 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:39.693030 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:39.693456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:39.694257 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:39.694706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:39.695132 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:39.757875 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:39.765810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c8800fca-70f5-4bf1-82f1-e85c0c4f340d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1310 microversion: 2.1 time: 0.084903 Sep 28 15:49:39.766403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 453/915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:39 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:40.790256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:40.790859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:40.817484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:40.818391 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:40.819025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:40.822134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:40.822778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:40.823374 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:41.389740 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:41.406040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e6856818-b389-4058-afcb-4adac143423f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.619721 Sep 28 15:49:41.410178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 463/916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:40 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:42.279019 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-1fc85f87-a584-446e-a38f-8ae12d115c29 req-54762422-0273-4b7d-8087-8dc4bdd592a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:42.295815 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-1fc85f87-a584-446e-a38f-8ae12d115c29 req-54762422-0273-4b7d-8087-8dc4bdd592a8 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:42.298363 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-1fc85f87-a584-446e-a38f-8ae12d115c29 req-54762422-0273-4b7d-8087-8dc4bdd592a8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:42.301596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-1fc85f87-a584-446e-a38f-8ae12d115c29 req-54762422-0273-4b7d-8087-8dc4bdd592a8 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:42.328122 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-1fc85f87-a584-446e-a38f-8ae12d115c29 req-54762422-0273-4b7d-8087-8dc4bdd592a8 service nova] Creating event network-changed:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:49:42.339123 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-1fc85f87-a584-446e-a38f-8ae12d115c29 req-54762422-0273-4b7d-8087-8dc4bdd592a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064032 Sep 28 15:49:42.340790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 454/917] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:42.438024 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:42.439437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:42.460470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:42.461401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:42.461840 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:42.468620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:42.469824 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:42.471848 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:42.663337 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:42.675061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-20929a7d-0ac5-4bc1-af14-8faa6872fddc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.241273 Sep 28 15:49:42.680706 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 464/918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:42 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:43.711552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:43.712354 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:43.718986 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:43.719356 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:43.720403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:43.721286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:43.722084 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:43.723253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:43.907475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:43.922145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-71d52238-07a5-4a9e-a97e-dffe0f5072ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.214990 Sep 28 15:49:43.923445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 455/919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:43 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:44.946998 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:44.947895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:44.954931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:44.955415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:44.955841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:44.956538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:44.956991 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:44.957412 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:45.126492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:45.134762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-22203404-8ca7-4658-ad4f-73c424521034 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.191453 Sep 28 15:49:45.135338 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 465/920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:44 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:46.159396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:46.160142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:46.167394 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:46.168263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:46.168934 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:46.169945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:46.170466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:46.171326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:46.319550 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:46.327857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1589b1a6-fbfc-4e12-be19-211455bdf1b4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.172792 Sep 28 15:49:46.342776 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 456/921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:46 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:47.354329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:47.355660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:47.363662 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:47.364459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:47.365098 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:47.366048 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:47.366719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:47.367335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:47.534809 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:47.546468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b233dcb1-d067-4e8d-897d-ac94072b8d18 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.195871 Sep 28 15:49:47.547973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 466/922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:47 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:48.570104 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:48.570742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:48.573360 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:48.574068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=10 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:48.579408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:48.580260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:48.580870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:48.581753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:48.582934 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:48.583519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:48.722382 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:48.730032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a3cbdcd1-4702-47ae-9592-52055a422a84 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.163757 Sep 28 15:49:48.730604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 457/923] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:48 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:49.754504 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:49.755075 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:49.757371 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:49:49.762710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:49.763250 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:49.763694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:49.764385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:49.764835 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:49.765252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:50.032323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:50.045590 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e55325c3-2d5a-4bec-b166-b0e5464395cc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.295588 Sep 28 15:49:50.046296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 467/924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:49 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:51.069302 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:51.070863 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:51.077622 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:51.078149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:51.078604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:51.079299 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:51.079744 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:51.080401 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:51.237408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:51.245065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-710048d1-c1ea-412e-87d1-65f98ab119ae tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.179732 Sep 28 15:49:51.245629 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 458/925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:51 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:52.269459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:52.270020 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:52.276545 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:52.277030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:52.277486 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:52.278220 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:52.278674 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:52.279096 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:52.406313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:52.414595 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-30af9f18-1cde-4c08-9075-0c3afd792afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.149710 Sep 28 15:49:52.415163 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 468/926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:52 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:53.438007 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:53.438910 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:53.446435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:53.447255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:53.447885 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:53.448688 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:53.449428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:53.450078 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:53.605745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:53.614834 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f511fa4b-7f0b-4140-822d-18811e960afd tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.181001 Sep 28 15:49:53.615884 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 459/927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:53 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:54.343258 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1563608757", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866724906", "security_groups": [{"name": "tempest-secgroup-smoke-984375930"}], "block_device_mapping_v2": [{"uuid": "1b4cbebc-03f2-4c8b-b11e-5fe6bb67cd19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb9fb97-d7e5-4300-bbd7-06e3c43ead21"}]}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:54.468894 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] validate_networks() for [('3cb9fb97-d7e5-4300-bbd7-06e3c43ead21', None, None, None, None, None)] {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:49:54.637603 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:54.638303 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:54.645156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:54.645644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:54.646293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:54.646920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:54.647427 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:54.647846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:54.878451 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:54.887829 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-44e026e6-90a2-4e7e-8296-eb366fbdd5e9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.253567 Sep 28 15:49:54.889295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 460/928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:54 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:54.921588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:49:54.922056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:49:54.922526 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:49:54.922936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:49:54.923379 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:49:54.931940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:54.932431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:54.932861 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:54.933590 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:54.934077 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:54.934500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:54.951316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:49:54.955974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for user 5fac9ab7665b4f14936adea96ae22ec4 and project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:49:55.013198 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:49:55.015331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b4cbebc-03f2-4c8b-b11e-5fe6bb67cd19',volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:49:55.145153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [5f20ce3a-e930-426d-9160-160bb1dd2b23] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 15:49:55.514850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-91ec971e-57b4-4e0b-9f32-ba11216785b6 req-54b27b69-7ab3-42f6-b343-641c8f398ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "name": "network-vif-plugged", "status": "completed", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:55.530107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-91ec971e-57b4-4e0b-9f32-ba11216785b6 req-54b27b69-7ab3-42f6-b343-641c8f398ead service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:55.530585 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-91ec971e-57b4-4e0b-9f32-ba11216785b6 req-54b27b69-7ab3-42f6-b343-641c8f398ead service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:55.531006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-91ec971e-57b4-4e0b-9f32-ba11216785b6 req-54b27b69-7ab3-42f6-b343-641c8f398ead service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:55.562638 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-91ec971e-57b4-4e0b-9f32-ba11216785b6 req-54b27b69-7ab3-42f6-b343-641c8f398ead service nova] Creating event network-vif-plugged:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:49:55.569436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-91ec971e-57b4-4e0b-9f32-ba11216785b6 req-54b27b69-7ab3-42f6-b343-641c8f398ead service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058870 Sep 28 15:49:55.570237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 461/929] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:49:55.913426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:55.914113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:55.920266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:55.920750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:55.921188 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:55.921886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:55.922341 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:55.922766 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:56.051518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:56.059065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c75087e2-0c58-4097-8351-4a987498003b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.151772 Sep 28 15:49:56.059656 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 462/930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:55 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:56.152359 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [5f20ce3a-e930-426d-9160-160bb1dd2b23] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 50108. Sep 28 15:49:56.156450 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a9cf66fb-5bc7-40cf-82e0-0d9be331c6e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.817112 Sep 28 15:49:56.157253 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 469/931] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:49:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:49:56.168960 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f2f17ae4-6825-4cf9-b8a0-28d1bd373070 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:56.169508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f2f17ae4-6825-4cf9-b8a0-28d1bd373070 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:56.222055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f2f17ae4-6825-4cf9-b8a0-28d1bd373070 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:56.228701 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f2f17ae4-6825-4cf9-b8a0-28d1bd373070 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1095 microversion: 2.1 time: 0.063667 Sep 28 15:49:56.229264 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 463/932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:56 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:57.081945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:57.082565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:57.089069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:57.089558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:57.090024 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:57.090801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:57.091276 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:57.091686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:57.254026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:57.255984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:57.273178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:57.274027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:57.274674 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:57.275561 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:57.275709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:57.279967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:57.280724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:57.284425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8da062eb-6f09-489b-96d8-c84fd334ce7f tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1358 microversion: 2.1 time: 0.206891 Sep 28 15:49:57.285010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 470/933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:57 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:57.377434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:57.386031 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f2ccff6e-dc3f-405d-9bac-3aa19872d930 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1193 microversion: 2.1 time: 0.137537 Sep 28 15:49:57.386609 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 464/934] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:57 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:58.310718 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.311331 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:58.333402 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.333923 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.334416 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.335239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.335698 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.336124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.409499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.410260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:58.416754 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.417311 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.417812 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.418617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.419132 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.419617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.614862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:58.623864 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-34a0dcea-265c-440c-9efc-4c0ca143a743 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1548 microversion: 2.1 time: 0.317024 Sep 28 15:49:58.625141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 471/935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:58 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1548 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:58.648169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.648978 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:58.655589 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.656105 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.656811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.658429 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.659285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.659985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.761788 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:58.772330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f02ab67b-d5dc-4894-b1b3-2c360cdc62b6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.367220 Sep 28 15:49:58.773207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 465/936] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:58 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:58.915335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:58.925984 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-434d03b4-8363-4cda-9d18-14458a27fcb1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1548 microversion: 2.1 time: 0.282264 Sep 28 15:49:58.937870 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 472/937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:58 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1548 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:49:58.949402 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:58.955067 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:58.955650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Searching by: {'deleted': False, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a'} {{(pid=127073) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 28 15:49:58.962593 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.963160 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.963491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:58.964448 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:58.965113 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:58.965744 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.066185 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.multi_cell_list [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 28 15:49:59.322476 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-395aaa1e-d8f5-4361-b370-8303ca9d36c4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.376530 Sep 28 15:49:59.323069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 466/938] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Sep 28 15:49:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:59.334680 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:59.335357 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:59.342141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.342545 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.342982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.343684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.344138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.344596 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.539707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:49:59.547507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5fa33d48-e4e1-45eb-9729-bdbd0e541e93 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1548 microversion: 2.1 time: 0.216605 Sep 28 15:49:59.548875 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 473/939] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:59 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:49:59.556157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-583a4cbe-1e3f-439f-b103-a0c676c779a9 req-68cf2dfe-25dd-47b4-b11f-6367f9f0479e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c8bf17-ac25-4fa7-a79d-521d43b9902c", "tag": "b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:49:59.566489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-583a4cbe-1e3f-439f-b103-a0c676c779a9 req-68cf2dfe-25dd-47b4-b11f-6367f9f0479e service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.566833 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-583a4cbe-1e3f-439f-b103-a0c676c779a9 req-68cf2dfe-25dd-47b4-b11f-6367f9f0479e service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.566979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-583a4cbe-1e3f-439f-b103-a0c676c779a9 req-68cf2dfe-25dd-47b4-b11f-6367f9f0479e service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.578908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-583a4cbe-1e3f-439f-b103-a0c676c779a9 req-68cf2dfe-25dd-47b4-b11f-6367f9f0479e service nova] Creating event network-changed:b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b for instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c on hv-cinder-85931 Sep 28 15:49:59.584504 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-583a4cbe-1e3f-439f-b103-a0c676c779a9 req-68cf2dfe-25dd-47b4-b11f-6367f9f0479e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031821 Sep 28 15:49:59.586395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 467/940] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:49:59.796432 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:49:59.797043 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:49:59.805287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.805830 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.806372 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:49:59.807165 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:49:59.807863 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:49:59.808487 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:00.037927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:00.046908 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-aca9b966-229f-40ae-b165-22e8dcd0d478 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.255304 Sep 28 15:50:00.062320 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 474/941] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:49:59 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:01.070471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:01.071367 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:01.077236 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:01.077704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:01.078156 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:01.078839 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:01.079288 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:01.079709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:01.130872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a384da3-3f23-444d-b741-46a4e0d695f9"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:01.133511 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:01.140157 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:01.140641 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:01.141076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:01.141829 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:01.142311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:01.142733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:01.212166 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:01.220386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f4de3469-7922-40d9-9d66-f05e99030a27 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.153898 Sep 28 15:50:01.220937 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 468/942] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:01 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:01.381783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-42296f87-cd45-4475-9ec8-10970262d0e3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254736 Sep 28 15:50:01.382633 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 475/943] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 15:50:01 2022] POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:50:02.243908 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:02.244518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:02.251398 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:02.251882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:02.252314 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.253024 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:02.253572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:02.253915 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:02.389229 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:02.397612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7c16e44b-6ae4-4ea4-9c9f-cf90a3a0baac tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.157458 Sep 28 15:50:02.398301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 469/944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:02 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:03.421565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:03.422312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:03.428505 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:03.428985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:03.429444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:03.430146 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:03.430602 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:03.431095 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:03.574223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:03.582125 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-41df32e3-a353-4908-852d-811ac97eb23d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.165284 Sep 28 15:50:03.582681 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 476/945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:03 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:04.604415 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:04.605035 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:04.607465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:04.613165 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:04.613657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:04.614125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:04.614827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:04.615285 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:04.615715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:04.628150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=89 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:04.744015 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:04.754654 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f93bf488-8b8f-44f7-bec7-6e7628fe23c6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.154088 Sep 28 15:50:04.755205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 470/946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:04 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:05.376634 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1859395341", "imageRef": "64ecee43-ab33-41ac-8878-0345e8fe3ab2", "flavorRef": "452"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:05.384126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:05.384788 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:05.429802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.network.neutron [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] validate_networks() for None {{(pid=127074) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:50:05.778218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:05.778846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:05.786469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:05.786966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:05.787406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:05.788125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:05.788584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:05.789013 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:06.008581 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Flavor limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:50:06.009002 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Image limits 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:50:06.009472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Flavor pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:50:06.009896 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Image pref 0:0:0 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:50:06.010308 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.virt.hardware [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127074) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:50:06.021965 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:06.022457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:06.022890 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:06.023625 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:06.024097 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:06.024521 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:06.034468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:06.041447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Getting quotas for project bf6381246ada4ba084f7cc0d514def4f. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:50:06.042064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5033fb8f-b235-45be-be8d-9638899eef2b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.267856 Sep 28 15:50:06.042907 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 471/947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:05 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:06.045689 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.quota [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Getting quotas for user e58268726b07457884cd7e250437ec78 and project bf6381246ada4ba084f7cc0d514def4f. Resources: {'ram', 'instances', 'cores'} {{(pid=127074) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:50:06.057501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Going to run 1 instances... {{(pid=127074) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:50:06.059823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64ecee43-ab33-41ac-8878-0345e8fe3ab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127074) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:50:06.104555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-753c8e09-8901-497d-8bc1-d683b4bf2bcb tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732316 Sep 28 15:50:06.105199 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 477/948] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:50:06.116871 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-66aa6511-8577-43fe-8e48-024d5a4137d3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:06.117487 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-66aa6511-8577-43fe-8e48-024d5a4137d3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:06.169219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-66aa6511-8577-43fe-8e48-024d5a4137d3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:06.177829 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-66aa6511-8577-43fe-8e48-024d5a4137d3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1215 microversion: 2.1 time: 0.064741 Sep 28 15:50:06.178438 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 472/949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:06 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:07.066554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:07.067213 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:07.073799 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.074317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.074755 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.075448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.075906 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.076333 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.200468 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:07.201141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:07.202608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:07.208030 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.208516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.208947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.209640 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:07.210304 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:07.210666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:07.211216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a8f1a335-bd90-41af-aa8e-88cef7d4c83d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.149721 Sep 28 15:50:07.211795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 478/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:07 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:07.273045 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:07.280698 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7f12ba5a-f65e-45e1-82aa-81546fd854b5 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1267 microversion: 2.1 time: 0.084364 Sep 28 15:50:07.281246 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 473/951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:07 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:08.234989 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:08.235977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:08.238490 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:08.243981 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:08.244481 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:08.244917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:08.245614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:08.246100 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:08.246525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:08.250796 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:08.304098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:08.304709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:08.311037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:08.311516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:08.311949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:08.312677 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:08.313137 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:08.313562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:08.400207 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:08.408892 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-50975f91-82d9-474c-9e3e-a450b17c9164 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1273 microversion: 2.1 time: 0.108702 Sep 28 15:50:08.409454 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 474/952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:08 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:08.488084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:08.496593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-49d435cf-9ae7-40f4-8d20-56653dbe4daf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.265599 Sep 28 15:50:08.497167 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 479/953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:08 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:09.004071 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:09.004787 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:09.006810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:09.012233 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.012790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.013228 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.013946 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.014512 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.014937 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.259168 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:09.267966 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d8d82422-c192-4b1d-9354-b50d409ca860 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1594 microversion: 2.1 time: 0.267367 Sep 28 15:50:09.268715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 475/954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:08 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1594 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:09.431516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:09.432148 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:09.439726 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.440515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.441136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.442080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.442727 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.443336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.521794 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:09.522582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:09.540469 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.542020 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.543258 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.543945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.544951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.545618 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.783491 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:09.793244 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c9219237-0753-4724-8fa0-49fb19c0c5de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.365427 Sep 28 15:50:09.793823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 480/955] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:09 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:09.799099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-31244ad5-ca1d-46f6-b7fa-281f94383b18 req-a4f69daa-f2c6-4632-bb14-5fd525568307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcdadee-8e7f-4c26-8977-691ad99ca087", "tag": "94bd65ef-947c-49ea-b210-1af43d80c7d7"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:09.808929 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-31244ad5-ca1d-46f6-b7fa-281f94383b18 req-a4f69daa-f2c6-4632-bb14-5fd525568307 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.809650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-31244ad5-ca1d-46f6-b7fa-281f94383b18 req-a4f69daa-f2c6-4632-bb14-5fd525568307 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.810351 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-31244ad5-ca1d-46f6-b7fa-281f94383b18 req-a4f69daa-f2c6-4632-bb14-5fd525568307 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.822471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-31244ad5-ca1d-46f6-b7fa-281f94383b18 req-a4f69daa-f2c6-4632-bb14-5fd525568307 service nova] Creating event network-changed:94bd65ef-947c-49ea-b210-1af43d80c7d7 for instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 on hv-cinder-85931 Sep 28 15:50:09.830609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-31244ad5-ca1d-46f6-b7fa-281f94383b18 req-a4f69daa-f2c6-4632-bb14-5fd525568307 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 Sep 28 15:50:09.831571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 481/956] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:09.837264 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-fc5d8d06-9a53-46eb-bcb0-ecfbd7a48039 req-36cbbed5-44f5-4c94-82d4-d1928dc94282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c8bf17-ac25-4fa7-a79d-521d43b9902c", "name": "network-vif-plugged", "status": "completed", "tag": "b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:09.847912 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-fc5d8d06-9a53-46eb-bcb0-ecfbd7a48039 req-36cbbed5-44f5-4c94-82d4-d1928dc94282 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:09.848421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-fc5d8d06-9a53-46eb-bcb0-ecfbd7a48039 req-36cbbed5-44f5-4c94-82d4-d1928dc94282 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:09.848852 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-fc5d8d06-9a53-46eb-bcb0-ecfbd7a48039 req-36cbbed5-44f5-4c94-82d4-d1928dc94282 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:09.857740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:09.860533 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-fc5d8d06-9a53-46eb-bcb0-ecfbd7a48039 req-36cbbed5-44f5-4c94-82d4-d1928dc94282 service nova] Creating event network-vif-plugged:b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b for instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c on hv-cinder-85931 Sep 28 15:50:09.865469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-fc5d8d06-9a53-46eb-bcb0-ecfbd7a48039 req-36cbbed5-44f5-4c94-82d4-d1928dc94282 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032777 Sep 28 15:50:09.866107 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 482/957] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:09.868567 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c1ed8080-0169-4d97-a9fd-c194174b9d06 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.351916 Sep 28 15:50:09.869268 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 476/958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:09 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:10.819771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:10.821190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:10.827985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.828739 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.829278 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.830871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.830871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.832138 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.891676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:10.892541 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:10.901145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.901732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.902257 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:10.903182 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:10.903710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:10.904212 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.015142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:11.023686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a499b767-11f8-4423-ad10-5a5571b9edb1 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.208571 Sep 28 15:50:11.024266 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 483/959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:10 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:11.075012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:11.085199 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8e6c22f0-3541-4e21-889f-65ddbebca018 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1266 microversion: 2.1 time: 0.197436 Sep 28 15:50:11.085872 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 477/960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:10 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:11.335719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-9ed8dc50-1238-42e4-b359-15f1d7c019f4 req-a25cd4e5-3e20-4af5-a1c3-257832dfb5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:11.366282 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-9ed8dc50-1238-42e4-b359-15f1d7c019f4 req-a25cd4e5-3e20-4af5-a1c3-257832dfb5ca service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:11.366758 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-9ed8dc50-1238-42e4-b359-15f1d7c019f4 req-a25cd4e5-3e20-4af5-a1c3-257832dfb5ca service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:11.367333 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-9ed8dc50-1238-42e4-b359-15f1d7c019f4 req-a25cd4e5-3e20-4af5-a1c3-257832dfb5ca service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:11.379346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-9ed8dc50-1238-42e4-b359-15f1d7c019f4 req-a25cd4e5-3e20-4af5-a1c3-257832dfb5ca service nova] Creating event network-changed:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:50:11.384961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-9ed8dc50-1238-42e4-b359-15f1d7c019f4 req-a25cd4e5-3e20-4af5-a1c3-257832dfb5ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053463 Sep 28 15:50:11.385762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 484/961] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:12.050461 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:12.051723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:12.058856 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.059347 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.059782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.060895 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.061355 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.062006 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.111097 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:12.112408 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:12.118675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.119365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.119801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.120501 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.120953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.121368 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.459818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:12.468582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-8c23ae6c-2756-46f0-b012-44f931f0f17f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.422523 Sep 28 15:50:12.482467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 478/962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:12 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:12.550965 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:12.562132 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9918075e-7b3a-426d-bef8-1a01de8f99e3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1454 microversion: 2.1 time: 0.456253 Sep 28 15:50:12.563540 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 485/963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:12 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1454 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:50:12.586505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:12.587269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:12.594671 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.595177 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.595619 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.596490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.596960 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.597842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.618312 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-75370381"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:12.618855 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:12.626137 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.626620 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.627050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:12.627741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:12.628192 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:12.629084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.229065 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.237763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9313da88-0416-4adc-8ddd-33fe24d0910b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1454 microversion: 2.1 time: 0.655651 Sep 28 15:50:13.238353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 479/964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:12 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1454 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:13.245413 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.network.security_group_api [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Adding security group da016f62-0a68-4648-a2fc-bf694519034d to port 19a4bc09-243d-4df6-a53f-ffce83a0b6e9 Sep 28 15:50:13.499151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.501485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.511554 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.512326 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.512947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.513658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.514322 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.515027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.741409 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:13.751832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9b62d319-14ec-4b4f-b8f6-57e5a8380348 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.261964 Sep 28 15:50:13.753119 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 480/965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:13 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:13.760038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ce1bb51b-5760-430c-93fd-786c083c3d68 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/action" status: 202 len: 0 microversion: 2.1 time: 1.145956 Sep 28 15:50:13.764102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 486/966] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:50:12 2022] POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/action => generated 0 bytes in 1151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:50:13.771448 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-e14907ff-b7d0-4df0-9bd2-0e3c04356008 req-a51c20e3-2f51-468f-b8d4-67f47503d521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:13.773747 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:13.774426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:13.782172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.783284 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-e14907ff-b7d0-4df0-9bd2-0e3c04356008 req-a51c20e3-2f51-468f-b8d4-67f47503d521 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.783447 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.783842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.784274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-e14907ff-b7d0-4df0-9bd2-0e3c04356008 req-a51c20e3-2f51-468f-b8d4-67f47503d521 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.784546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:13.785046 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-e14907ff-b7d0-4df0-9bd2-0e3c04356008 req-a51c20e3-2f51-468f-b8d4-67f47503d521 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.785276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:13.785705 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:13.811447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-e14907ff-b7d0-4df0-9bd2-0e3c04356008 req-a51c20e3-2f51-468f-b8d4-67f47503d521 service nova] Creating event network-changed:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:50:13.824597 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-e14907ff-b7d0-4df0-9bd2-0e3c04356008 req-a51c20e3-2f51-468f-b8d4-67f47503d521 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056560 Sep 28 15:50:13.825222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 487/967] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:50:14.057028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:14.066808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b8366772-c038-4104-a263-4077b2ed371b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1756 microversion: 2.1 time: 0.301433 Sep 28 15:50:14.067935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 481/968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:13 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1756 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:14.778061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:14.778760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:14.785611 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.786124 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.786566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.787287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:14.787741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:14.788303 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:14.921833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:14.930083 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1a1f21ab-339a-4c83-99c3-e1dac9366756 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.156528 Sep 28 15:50:14.930584 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 488/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:14 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:15.267427 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-454bc365-f506-4124-bf34-37a6c8bc4691 req-c6faba59-f991-4bf2-a631-05d9edc06d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77c8bf17-ac25-4fa7-a79d-521d43b9902c", "tag": "b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:15.277342 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-454bc365-f506-4124-bf34-37a6c8bc4691 req-c6faba59-f991-4bf2-a631-05d9edc06d21 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.277818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-454bc365-f506-4124-bf34-37a6c8bc4691 req-c6faba59-f991-4bf2-a631-05d9edc06d21 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.278276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-454bc365-f506-4124-bf34-37a6c8bc4691 req-c6faba59-f991-4bf2-a631-05d9edc06d21 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.289999 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-454bc365-f506-4124-bf34-37a6c8bc4691 req-c6faba59-f991-4bf2-a631-05d9edc06d21 service nova] Creating event network-changed:b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b for instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c on hv-cinder-85931 Sep 28 15:50:15.295076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-454bc365-f506-4124-bf34-37a6c8bc4691 req-c6faba59-f991-4bf2-a631-05d9edc06d21 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031810 Sep 28 15:50:15.295859 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 482/970] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:15.619879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-afb09f90-03af-4082-8d2e-ae7128e0b9ee req-73005f81-2977-41a6-8bec-022f5bcaa5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcdadee-8e7f-4c26-8977-691ad99ca087", "name": "network-vif-plugged", "status": "completed", "tag": "94bd65ef-947c-49ea-b210-1af43d80c7d7"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:15.632405 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-afb09f90-03af-4082-8d2e-ae7128e0b9ee req-73005f81-2977-41a6-8bec-022f5bcaa5ca service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.633137 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-afb09f90-03af-4082-8d2e-ae7128e0b9ee req-73005f81-2977-41a6-8bec-022f5bcaa5ca service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.633550 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-afb09f90-03af-4082-8d2e-ae7128e0b9ee req-73005f81-2977-41a6-8bec-022f5bcaa5ca service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.652266 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-afb09f90-03af-4082-8d2e-ae7128e0b9ee req-73005f81-2977-41a6-8bec-022f5bcaa5ca service nova] Creating event network-vif-plugged:94bd65ef-947c-49ea-b210-1af43d80c7d7 for instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 on hv-cinder-85931 Sep 28 15:50:15.662166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-afb09f90-03af-4082-8d2e-ae7128e0b9ee req-73005f81-2977-41a6-8bec-022f5bcaa5ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050038 Sep 28 15:50:15.663261 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 489/971] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:15.955301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:15.956125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:15.962648 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.963464 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.964001 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:15.964793 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:15.965325 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:15.965825 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:16.105408 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:16.113821 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d2a2b9b4-f0f2-4a3b-9376-5c3a8c712660 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.164868 Sep 28 15:50:16.114457 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 483/972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:15 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:17.134679 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:17.135465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:17.139497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:17.140713 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:17.147791 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:17.148277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:17.148710 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:17.149399 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:17.149877 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:17.150299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:17.278450 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:17.286871 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-277830d7-1f39-413e-96ed-f800d17531a3 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1315 microversion: 2.1 time: 0.153704 Sep 28 15:50:17.287431 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 490/973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:17 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:18.308496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:18.309105 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:18.311089 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=4 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:18.316654 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.317130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.317565 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.318279 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.318732 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.319157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.467211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.475251 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6f87a0c2-cdc7-4141-b4a1-b3b18a2c9b0e tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1465 microversion: 2.1 time: 0.170687 Sep 28 15:50:18.475807 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 484/974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:18 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1465 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:18.522181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:18.522664 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:18.529029 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.529544 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.530005 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.531363 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.531819 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.532245 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.556702 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:50:18.632478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-13aac085-b47a-4ea4-a676-b3ca96465d5f tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 204 len: 0 microversion: 2.1 time: 0.113801 Sep 28 15:50:18.633344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 491/975] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:50:18 2022] DELETE /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:50:18.643202 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:18.643827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:18.650129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.650612 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.651050 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.651748 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:18.652206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:18.652631 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:18.789700 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:18.797444 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e685a42b-0d18-49cc-b361-e611f7f166de tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1471 microversion: 2.1 time: 0.159254 Sep 28 15:50:18.798097 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 485/976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:18 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:19.821377 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:19.822117 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:19.828556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.829035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.829466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.830181 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:19.830627 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:19.831050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:19.957816 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:19.965571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5fb32b70-2a37-48c0-8779-083d18a06c4c tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1471 microversion: 2.1 time: 0.148429 Sep 28 15:50:19.966169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 492/977] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:19 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:20.540068 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-14680ca1-076d-4ac4-97b0-fc791f4355d6 req-2fcb8727-4471-4d83-b69b-e7af5a6d9dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcdadee-8e7f-4c26-8977-691ad99ca087", "name": "network-vif-deleted", "tag": "94bd65ef-947c-49ea-b210-1af43d80c7d7"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:20.550740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-14680ca1-076d-4ac4-97b0-fc791f4355d6 req-2fcb8727-4471-4d83-b69b-e7af5a6d9dd0 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.551243 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-14680ca1-076d-4ac4-97b0-fc791f4355d6 req-2fcb8727-4471-4d83-b69b-e7af5a6d9dd0 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.551657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-14680ca1-076d-4ac4-97b0-fc791f4355d6 req-2fcb8727-4471-4d83-b69b-e7af5a6d9dd0 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.563885 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-14680ca1-076d-4ac4-97b0-fc791f4355d6 req-2fcb8727-4471-4d83-b69b-e7af5a6d9dd0 service nova] Creating event network-vif-deleted:94bd65ef-947c-49ea-b210-1af43d80c7d7 for instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 on hv-cinder-85931 Sep 28 15:50:20.568897 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-14680ca1-076d-4ac4-97b0-fc791f4355d6 req-2fcb8727-4471-4d83-b69b-e7af5a6d9dd0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032437 Sep 28 15:50:20.569973 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 486/978] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:50:20.989592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:20.990129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:20.996518 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.997004 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.997437 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:20.998146 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:20.998598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:20.999018 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:21.035670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:21.036223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:21.036656 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:21.037092 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lazy-loading 'fault' on Instance uuid 6fcdadee-8e7f-4c26-8977-691ad99ca087 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:50:21.080730 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58268726b07457884cd7e250437ec78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf6381246ada4ba084f7cc0d514def4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:21.088492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9ffb59f6-45db-49a8-a359-400765fdf178 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 200 len: 1305 microversion: 2.1 time: 0.102817 Sep 28 15:50:21.089061 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 493/979] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:20 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:22.112959 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:22.113645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] [instance: 6fcdadee-8e7f-4c26-8977-691ad99ca087] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:22.119750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:22.120225 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:22.120651 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:22.121325 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:22.121771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:22.122217 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:22.135626 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] HTTP exception thrown: Instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 could not be found. Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Request method failure captured: Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 HTTP/1.1 Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNG0rRZJKg_VUbmHSRjGrsjcG_MqDP9ZrJ-bfVp--RbRu3u_oRRY0dSMUd5k1dg-Hn9lTeUfzsdOHysWyXBqty48b0LoEe8jaWEoAAvrw37HEClwh7SjQXUXTXwQxMz-V_kE8AgYxpJtsVAPlXrzHNUjMuc4IbsQYvQNAf0LuEczhdmw Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: bf6381246ada4ba084f7cc0d514def4f Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-VolumesNegativeTest-1942427557 Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:50:22.137248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6381246ada4ba084f7cc0d514def4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bf6381246ada4ba084f7cc0d514def4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bf6381246ada4ba084f7cc0d514def4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bf6381246ada4ba084f7cc0d514def4f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-VolumesNegativeTest-1942427557 Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: bf6381246ada4ba084f7cc0d514def4f Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-VolumesNegativeTest-1942427557 Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-VolumesNegativeTest-1942427557-project Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: e58268726b07457884cd7e250437ec78 Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-VolumesNegativeTest-1942427557-project Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 could not be found. Sep 28 15:50:22.139059 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '6fcdadee-8e7f-4c26-8977-691ad99ca087'} Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 could not be found. Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:50:22.140735 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 could not be found. Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 could not be found. Sep 28 15:50:22.142396 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:50:22.143831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] Returning 404 to user: Instance 6fcdadee-8e7f-4c26-8977-691ad99ca087 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:50:22.143831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-68e9d156-ea39-4501-8576-b4c918b39c88 tempest-VolumesNegativeTest-1942427557 tempest-VolumesNegativeTest-1942427557-project] 10.222.0.52 "GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087" status: 404 len: 111 microversion: 2.1 time: 0.030637 Sep 28 15:50:22.143831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 487/980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:22 2022] GET /compute/v2.1/servers/6fcdadee-8e7f-4c26-8977-691ad99ca087 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:50:36.417505 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:50:36.419717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:36.422548 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:36.423271 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:36.429309 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.429787 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.430249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.430946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.431401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.431822 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.504531 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c5c226d2-3afc-485f-9873-83a18bbcc65d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.090877 Sep 28 15:50:36.505147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 494/981] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:50:36 2022] POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:50:36.513471 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:36.514592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:36.516739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=37 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:36.517376 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=89 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:50:36.523083 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.523551 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.524026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.524689 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:36.525135 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:36.525551 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:36.672250 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:36.680962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a74a55dd-7763-424a-bee1-26584dacceeb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1748 microversion: 2.1 time: 0.171287 Sep 28 15:50:36.681644 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 488/982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:36 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:37.705647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:37.706389 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:37.712565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:37.713056 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:37.713496 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:37.714237 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:37.714700 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:37.715126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:37.856839 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:37.868279 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-adfa3402-dd10-48d8-80cd-58155b8a226e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.167135 Sep 28 15:50:37.868858 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 495/983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:37 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:38.892444 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:38.893057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:38.899513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:38.899990 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:38.900423 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:38.901112 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:38.901562 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:38.902016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:39.038769 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:39.047387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7e7c2f9e-997a-46be-850c-d7b71a6464c0 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.158795 Sep 28 15:50:39.047947 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 489/984] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:38 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:40.071250 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:40.071856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:40.078966 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:40.079445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:40.079887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:40.080571 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:40.081025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:40.081444 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:40.223177 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:40.231346 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-671cf9b0-07d4-4ed0-bc0e-fcbebf661a47 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.164000 Sep 28 15:50:40.231913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 496/985] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:40 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:41.255922 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:41.256514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:41.263018 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:41.263979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:41.264403 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:41.265085 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:41.265535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:41.265980 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:41.407774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:41.416751 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-38912acb-d5a1-4a74-b149-729ecf1687fb tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.164611 Sep 28 15:50:41.417320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 490/986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:41 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:42.440342 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:42.440948 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:42.447724 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:42.448200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:42.448632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:42.449313 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:42.449756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:42.450629 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:42.593927 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:42.602152 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ca39caf1-1abd-4db4-9eb6-dd3f1706092b tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.165889 Sep 28 15:50:42.602707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 497/987] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:42 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:43.625427 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:43.626175 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:43.632481 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:43.632975 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:43.633411 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:43.634147 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:43.634600 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:43.635026 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:43.858131 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:43.866671 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ef08230d-7ef4-4979-a067-3797a9448d10 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.245766 Sep 28 15:50:43.867422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 491/988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:43 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:44.889784 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:44.890433 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:44.896814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:44.897293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:44.897720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:44.898430 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:44.898887 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:44.899307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:45.036386 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:45.045291 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8f633341-2e8e-4022-b167-7284cabcb753 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.159426 Sep 28 15:50:45.045980 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 498/989] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:44 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:46.068913 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:46.069554 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:46.076578 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:46.077055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:46.077489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:46.078198 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:46.078655 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:46.079078 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:46.218611 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:46.226605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ebd8fb4b-6279-4a41-87c9-271e044e84df tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.161613 Sep 28 15:50:46.227189 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 492/990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:46 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:47.250225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:47.250786 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:47.257289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:47.257763 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:47.258223 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:47.258908 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:47.259517 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:47.259945 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:47.407301 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:47.415524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8baa0457-7a7a-4633-bf79-d18e6a33e75e tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.169330 Sep 28 15:50:47.416076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 499/991] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:47 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:48.439035 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:48.439650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:48.446200 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:48.446686 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:48.447133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:48.447825 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:48.448283 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:48.448709 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:48.588260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:48.597335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ba1c2920-e8b3-4e98-9150-9bf1994ceb7c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.162002 Sep 28 15:50:48.597956 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 493/992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:48 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:49.624103 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:49.624704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:49.631140 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:49.631615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:49.632043 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:49.632721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:49.633167 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:49.633585 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:49.789442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:49.798462 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-219c2a1e-0c0f-4e83-bbb7-70f488bef0f3 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.178871 Sep 28 15:50:49.799031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 500/993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:49 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:50.822266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:50.822920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:50.829483 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:50.829998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:50.830433 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:50.831128 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:50.831582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:50.832005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:50.972845 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:50.981012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ed96184d-7aa0-41bd-b57c-e80203af8292 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.162776 Sep 28 15:50:50.982098 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 494/994] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:50 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:52.006066 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:52.006623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:52.013722 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:52.014225 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:52.014654 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:52.015339 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:52.015793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:52.016215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:52.168227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:52.176651 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e9d44b07-57cd-4c74-8207-48702a13c5de tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.174528 Sep 28 15:50:52.177217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 501/995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:52 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:53.200880 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:53.201474 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:53.207742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:53.208216 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:53.208647 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:53.209327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:53.209774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:53.210220 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:53.352797 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:53.362052 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f28d83a7-2de9-4f49-a6ee-c5a455c32fa4 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1753 microversion: 2.1 time: 0.165430 Sep 28 15:50:53.362617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 495/996] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:53 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:50:54.385472 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:50:54.386104 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:50:54.392525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:54.392999 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:54.393515 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:54.394224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:50:54.394668 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:50:54.395080 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:50:54.538040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:50:54.546476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e1e5e001-567f-4052-851c-e2c8d291583d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1756 microversion: 2.1 time: 0.165055 Sep 28 15:50:54.547087 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 502/997] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:50:54 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:14.471222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:14.471847 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:14.473927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=16 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:14.474582 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=48 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:14.480202 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:14.480680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:14.481109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:14.481867 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:14.482372 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:14.483047 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:14.506442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lazy-loading 'flavor' on Instance uuid 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:51:14.583708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c9f5c803-0c40-4ce2-b6a8-6729b91b6488 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "POST /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9/action" status: 202 len: 0 microversion: 2.1 time: 0.115877 Sep 28 15:51:14.584316 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 496/998] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:51:14 2022] POST /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:51:14.594954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:14.595707 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:14.598122 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=18 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:14.598812 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:14.605409 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:14.605977 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:14.606423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:14.608190 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:14.608974 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:14.609486 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:14.761670 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:14.770341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-856b440e-332a-456f-a7cb-344999bbb404 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.181140 Sep 28 15:51:14.770936 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 503/999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:14 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:15.803319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:15.804037 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:15.810272 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:15.810792 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:15.811190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:15.811965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:15.812340 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:15.812760 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:15.965141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:15.972937 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f52d6de2-7c77-44e5-896f-7b4be5202541 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.174412 Sep 28 15:51:15.973498 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 497/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:15 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:16.996071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:16.996717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:17.003477 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:17.003961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:17.004398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:17.005090 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:17.005546 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:17.006008 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:17.137336 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:17.145200 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0e9b42dc-f160-46bd-aa7f-219057a20d85 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.153123 Sep 28 15:51:17.145765 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 504/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:16 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:18.168723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:18.169319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:18.175739 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:18.176222 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:18.176658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:18.177351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:18.177806 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:18.178255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:18.579916 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:18.587877 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c339f5fa-4307-43a1-ab6b-812050edaaf2 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.422923 Sep 28 15:51:18.588585 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 498/1002] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:18 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:19.611762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:19.612365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:19.618849 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.619425 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.619859 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.620542 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:19.620995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:19.621409 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:19.756764 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:19.765466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-18a39f43-bd32-4a98-bfcb-90e2f5d3cda3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.157908 Sep 28 15:51:19.767231 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 505/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:19 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:20.794422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:20.795067 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:20.801506 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:20.802017 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:20.802454 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:20.803149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:20.803605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:20.804029 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:20.943657 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:20.952166 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-be8e41f1-23b4-40ea-8e84-55bf320dbab3 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.161591 Sep 28 15:51:20.952740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 499/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:20 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:21.976003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:21.976605 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:21.984209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:21.984737 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:21.985216 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:21.986120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:21.986675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:21.987102 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:22.139640 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:22.147979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b53eb6ff-a7a3-44a9-a689-8a0ecfb6b01b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.175786 Sep 28 15:51:22.148561 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 506/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:21 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:23.172462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:23.173108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:23.179572 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:23.180057 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:23.180493 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:23.181199 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:23.181650 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:23.182164 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:23.329005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:23.336969 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f91d42f4-1724-4354-9084-5b41427dff1c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.168342 Sep 28 15:51:23.337552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 500/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:23 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:24.360617 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:24.361232 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:24.367888 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:24.368375 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:24.368806 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:24.370026 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:24.370484 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:24.370903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:24.529445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:24.537460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a906bcf4-5166-4ff3-8385-3a060a6e60b9 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.180941 Sep 28 15:51:24.538093 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 507/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:24 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:25.560668 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:25.561307 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:25.568016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:25.568496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:25.568923 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:25.569630 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:25.570117 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:25.570546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:25.759286 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:25.768570 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-055bb8d6-cf7a-4a1a-b8a3-9c0cd9829b7a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.211664 Sep 28 15:51:25.769157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 501/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:25 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:26.793071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:26.793747 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:26.805297 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:26.806156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:26.806726 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:26.808215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:26.808709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:26.809227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:26.982937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:26.991507 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b55e997e-af2c-46a3-bfbf-1148537760d8 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.202915 Sep 28 15:51:26.992142 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 508/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:26 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:51:27.355756 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-75370381"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:27.356435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:27.363796 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:27.364308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:27.364768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:27.365551 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:27.366070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:27.366513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:27.553023 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.network.security_group_api [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Removing security group da016f62-0a68-4648-a2fc-bf694519034d from port 19a4bc09-243d-4df6-a53f-ffce83a0b6e9 Sep 28 15:51:27.928132 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e3f177f8-e85d-493b-80c8-07d6051b7dbc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.576761 Sep 28 15:51:27.930734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-2f59f8c7-0060-4771-a398-547784793d6c req-87d5fbd5-aa56-4532-bc5f-90cf25f2b7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:27.934801 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 502/1010] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:51:27 2022] POST /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:51:27.955044 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-2f59f8c7-0060-4771-a398-547784793d6c req-87d5fbd5-aa56-4532-bc5f-90cf25f2b7de service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:27.956750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-2f59f8c7-0060-4771-a398-547784793d6c req-87d5fbd5-aa56-4532-bc5f-90cf25f2b7de service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:27.957902 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-2f59f8c7-0060-4771-a398-547784793d6c req-87d5fbd5-aa56-4532-bc5f-90cf25f2b7de service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:27.976632 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-2f59f8c7-0060-4771-a398-547784793d6c req-87d5fbd5-aa56-4532-bc5f-90cf25f2b7de service nova] Creating event network-changed:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:51:27.985815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-2f59f8c7-0060-4771-a398-547784793d6c req-87d5fbd5-aa56-4532-bc5f-90cf25f2b7de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065934 Sep 28 15:51:27.988012 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 509/1011] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:28.018970 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:28.019918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:28.037171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:28.039178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:28.040364 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:28.042039 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:28.043932 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:28.044958 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:28.940985 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:28.957359 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-138204f1-a2ed-4dcd-92bf-7cc54f40e17f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.943934 Sep 28 15:51:28.957971 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 503/1012] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:28 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:29.990644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:29.991540 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:30.003197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.003934 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.004457 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.005194 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.005735 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.006178 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.321764 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:30.323373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:30.336069 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.336951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.337765 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.339875 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.340712 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.341482 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.487191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:30.500423 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d89ffb02-c299-4f24-ac02-1db9ab0a2f43 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.516387 Sep 28 15:51:30.501556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 510/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:29 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:30.507189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-b5fb83d5-cfc6-42cc-a0ee-c97f7bfbaa46 req-375665c1-dc1a-4daf-884d-38f9b11f732a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:30.511528 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.objects.instance [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lazy-loading 'services' on Instance uuid 7d62c070-226f-4632-afcc-8b89ec928ef2 {{(pid=127073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:51:30.520970 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b5fb83d5-cfc6-42cc-a0ee-c97f7bfbaa46 req-375665c1-dc1a-4daf-884d-38f9b11f732a service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.522069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b5fb83d5-cfc6-42cc-a0ee-c97f7bfbaa46 req-375665c1-dc1a-4daf-884d-38f9b11f732a service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.522802 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-b5fb83d5-cfc6-42cc-a0ee-c97f7bfbaa46 req-375665c1-dc1a-4daf-884d-38f9b11f732a service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.541440 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-b5fb83d5-cfc6-42cc-a0ee-c97f7bfbaa46 req-375665c1-dc1a-4daf-884d-38f9b11f732a service nova] Creating event network-changed:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:51:30.547801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-b5fb83d5-cfc6-42cc-a0ee-c97f7bfbaa46 req-375665c1-dc1a-4daf-884d-38f9b11f732a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044737 Sep 28 15:51:30.550038 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 511/1014] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:30.651684 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-35b991b8-c6b7-4fb8-8f10-d3a680ea0e8d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments/9a384da3-3f23-444d-b741-46a4e0d695f9" status: 202 len: 0 microversion: 2.1 time: 0.336160 Sep 28 15:51:30.652768 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 504/1015] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:51:30 2022] DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments/9a384da3-3f23-444d-b741-46a4e0d695f9 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 15:51:30.669197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:30.673913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:30.687191 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.687695 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.688364 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.689120 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:30.689771 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:30.690421 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:30.743047 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-09b681ee-6e72-402a-9732-95db62ff1a6d tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082027 Sep 28 15:51:30.746390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 512/1016] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:51:30 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:31.532680 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:31.533522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:31.541205 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:31.541700 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:31.542329 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:31.543058 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:31.543513 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:31.543979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:31.722887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:31.736092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d5f8573d-5890-4953-809b-8c749c43269a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.207487 Sep 28 15:51:31.736944 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 505/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:31 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:31.761133 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:31.764760 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:31.779491 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:31.780320 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:31.781030 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:31.782269 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:31.783044 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:31.783759 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:31.817593 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cf5ad8f3-6a51-43bd-8dc1-a10a20f08ab9 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063870 Sep 28 15:51:31.818217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 513/1018] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:51:31 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:51:32.772320 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:32.773508 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:32.780870 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:32.781604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:32.782276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:32.783008 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:32.783484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:32.784153 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:32.833964 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:32.838497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:32.849940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:32.851256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:32.852252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:32.854059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:32.854931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:32.855519 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:32.912801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7f0be74a-8ac7-4ef2-a8a5-a84aaef36ebc tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083960 Sep 28 15:51:32.913883 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 514/1019] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 15:51:32 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 15:51:32.931658 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:32.932516 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:32.943404 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:32.944154 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:32.945022 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:32.946028 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:32.946832 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:32.948160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:32.991804 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:33.004827 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-db8bf45c-b9e6-4620-b462-6fd47308f0e1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.237874 Sep 28 15:51:33.005435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 506/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:32 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:33.075018 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] HTTP exception thrown: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 is not attached to volume 9a384da3-3f23-444d-b741-46a4e0d695f9 Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Request method failure captured: Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments/9a384da3-3f23-444d-b741-46a4e0d695f9 HTTP/1.1 Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGz2p8GD1_PkPmdiLO0mxvJigaLhLJuxQBDoKf1Ku9nZWhfQX5p_Xia6sVnWLL0DXFOkHWq2TvWUBSmB949bmj0V3uFYTlJUsDFFQKfgBK2WNLmoHbYQew8n255-khj6XfO4tkBmHi8PevmSDNsAyeRtUQlP1PQXqHufDaOuvFFMrjE Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 069626c3525d47a9b67f1e6d81b47b2a Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-TestMinimumBasicScenario-393187960 Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:51:33.077466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/069626c3525d47a9b67f1e6d81b47b2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/069626c3525d47a9b67f1e6d81b47b2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/069626c3525d47a9b67f1e6d81b47b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_069626c3525d47a9b67f1e6d81b47b2a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-TestMinimumBasicScenario-393187960 Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 069626c3525d47a9b67f1e6d81b47b2a Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-TestMinimumBasicScenario-393187960 Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-TestMinimumBasicScenario-393187960-project Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: a7a959e57e0c4713a855844645fdc26a Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-TestMinimumBasicScenario-393187960-project Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:51:33.080367 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 is not attached to volume 9a384da3-3f23-444d-b741-46a4e0d695f9 Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'server_id': '7d62c070-226f-4632-afcc-8b89ec928ef2', 'id': '9a384da3-3f23-444d-b741-46a4e0d695f9'} Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9a384da3-3f23-444d-b741-46a4e0d695f9. Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:51:33.081918 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 is not attached to volume 9a384da3-3f23-444d-b741-46a4e0d695f9 Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 is not attached to volume 9a384da3-3f23-444d-b741-46a4e0d695f9 Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:33.085938 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Returning 404 to user: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 is not attached to volume 9a384da3-3f23-444d-b741-46a4e0d695f9 {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:51:33.088804 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d9dfa5df-49e6-470f-ab85-2fdc82871038 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments/9a384da3-3f23-444d-b741-46a4e0d695f9" status: 404 len: 154 microversion: 2.1 time: 0.157622 Sep 28 15:51:33.088804 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 515/1021] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 15:51:32 2022] DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2/os-volume_attachments/9a384da3-3f23-444d-b741-46a4e0d695f9 => generated 154 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:51:34.046048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:34.046797 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:34.053970 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.054554 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.055062 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.055844 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.056414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.056905 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.276957 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:34.288525 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:34.290076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:34.290218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-12da5fec-d286-433d-affe-6539323e833e tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1510 microversion: 2.1 time: 0.247597 Sep 28 15:51:34.291436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 507/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:34 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:51:34.301062 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.301950 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.302752 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.304081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.304919 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.305748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.329373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:34.330455 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:34.340989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.341832 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.342617 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.343857 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.344671 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.345416 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.353773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:51:34.399290 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127073) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 15:51:34.483823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-52809dc9-826e-41cd-a94d-4c99c0e798d1 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 204 len: 0 microversion: 2.1 time: 0.200987 Sep 28 15:51:34.484924 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 516/1023] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:51:34 2022] DELETE /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:51:34.496076 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:34.496995 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:34.500994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-869985a6-b2f1-48b7-ad8e-9769c31a0a4b tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "POST /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9/action" status: 202 len: 0 microversion: 2.1 time: 0.179320 Sep 28 15:51:34.501912 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 508/1024] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 15:51:34 2022] POST /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:51:34.506239 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.506960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.507502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.508492 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.509160 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.510323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.511076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:34.511702 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:34.518181 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.518674 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.519114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.520708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:34.520708 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:34.521127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:34.526044 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:35.205755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:35.211463 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:35.221660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a9b09fe0-fa70-4768-9aa2-6bc817e6c716 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1554 microversion: 2.1 time: 0.730872 Sep 28 15:51:35.222616 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 517/1025] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:34 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1554 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:35.223669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f1b5d94f-395b-4f29-9a54-12402021391c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1518 microversion: 2.1 time: 0.717541 Sep 28 15:51:35.224319 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 509/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:34 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1518 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:51:35.988420 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-eec89804-cfd6-4422-9c20-817d665b97de req-4b36bd8f-a0f2-41be-b838-c43a54a73e5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "name": "network-vif-unplugged", "status": "completed", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:36.001500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-eec89804-cfd6-4422-9c20-817d665b97de req-4b36bd8f-a0f2-41be-b838-c43a54a73e5c service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:36.002025 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-eec89804-cfd6-4422-9c20-817d665b97de req-4b36bd8f-a0f2-41be-b838-c43a54a73e5c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:36.002460 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-eec89804-cfd6-4422-9c20-817d665b97de req-4b36bd8f-a0f2-41be-b838-c43a54a73e5c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:36.015439 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.compute.server_external_events [req-eec89804-cfd6-4422-9c20-817d665b97de req-4b36bd8f-a0f2-41be-b838-c43a54a73e5c service nova] Unable to find a host for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9. Dropping event network-vif-unplugged {{(pid=127074) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 15:51:36.016365 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-eec89804-cfd6-4422-9c20-817d665b97de req-4b36bd8f-a0f2-41be-b838-c43a54a73e5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033704 Sep 28 15:51:36.016939 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 518/1027] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 15:51:36.250658 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:36.251676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:36.262816 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:36.264460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:36.265464 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:36.267075 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:36.267268 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:36.267854 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:36.268271 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:36.269043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:36.274709 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:36.275495 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:36.276119 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:36.277016 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:36.277640 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:36.278270 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:36.608607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:36.613744 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:36.617955 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:36.620530 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-6a677161-a22c-44ee-8422-2668fa92ae73 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1554 microversion: 2.1 time: 0.374014 Sep 28 15:51:36.621422 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 510/1028] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:36 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:36.639953 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-4b43f5b4-f6b7-4698-861e-fe434902cc01 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1520 microversion: 2.1 time: 0.386534 Sep 28 15:51:36.640743 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 519/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:36 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:36.919289 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-0e600c5d-daa4-4481-8222-9ae12d1f284f req-2aab18cd-1de5-4b1d-a250-f60e4206d165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d62c070-226f-4632-afcc-8b89ec928ef2", "name": "network-vif-deleted", "tag": "19a4bc09-243d-4df6-a53f-ffce83a0b6e9"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:36.930531 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-0e600c5d-daa4-4481-8222-9ae12d1f284f req-2aab18cd-1de5-4b1d-a250-f60e4206d165 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:36.931055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-0e600c5d-daa4-4481-8222-9ae12d1f284f req-2aab18cd-1de5-4b1d-a250-f60e4206d165 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:36.931500 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-0e600c5d-daa4-4481-8222-9ae12d1f284f req-2aab18cd-1de5-4b1d-a250-f60e4206d165 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:36.944475 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-0e600c5d-daa4-4481-8222-9ae12d1f284f req-2aab18cd-1de5-4b1d-a250-f60e4206d165 service nova] Creating event network-vif-deleted:19a4bc09-243d-4df6-a53f-ffce83a0b6e9 for instance 7d62c070-226f-4632-afcc-8b89ec928ef2 on hv-cinder-85931 Sep 28 15:51:36.953336 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-0e600c5d-daa4-4481-8222-9ae12d1f284f req-2aab18cd-1de5-4b1d-a250-f60e4206d165 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037938 Sep 28 15:51:36.954442 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 511/1030] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:51:37.648275 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:37.649084 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:37.657328 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:37.658147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:37.659192 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:37.659926 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:37.660465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:37.661029 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:37.676845 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:37.678127 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:37.689548 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:37.690109 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:37.690527 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:37.691894 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:37.692352 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:37.692950 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:37.696972 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:37.697765 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:37.698445 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:37.698894 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lazy-loading 'fault' on Instance uuid 7d62c070-226f-4632-afcc-8b89ec928ef2 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:51:37.769053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a959e57e0c4713a855844645fdc26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069626c3525d47a9b67f1e6d81b47b2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:37.779740 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2b9117a3-103a-4e1b-b819-10b0ea791d3c tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 200 len: 1348 microversion: 2.1 time: 0.138788 Sep 28 15:51:37.780973 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 520/1031] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:37 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 1348 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:37.960962 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:37.969830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-22d81eaa-c545-4bb6-80ed-24af7e3ba7f1 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.309157 Sep 28 15:51:37.970518 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 512/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:37 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:38.804757 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:38.805355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] [instance: 7d62c070-226f-4632-afcc-8b89ec928ef2] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:38.812861 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:38.813415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:38.813773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:38.813773 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:38.814944 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:38.815398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:38.830318 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] HTTP exception thrown: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 could not be found. Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Request method failure captured: Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 HTTP/1.1 Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNGz2p8GD1_PkPmdiLO0mxvJigaLhLJuxQBDoKf1Ku9nZWhfQX5p_Xia6sVnWLL0DXFOkHWq2TvWUBSmB949bmj0V3uFYTlJUsDFFQKfgBK2WNLmoHbYQew8n255-khj6XfO4tkBmHi8PevmSDNsAyeRtUQlP1PQXqHufDaOuvFFMrjE Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 069626c3525d47a9b67f1e6d81b47b2a Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-TestMinimumBasicScenario-393187960 Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:51:38.831982 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/069626c3525d47a9b67f1e6d81b47b2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/069626c3525d47a9b67f1e6d81b47b2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/069626c3525d47a9b67f1e6d81b47b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_069626c3525d47a9b67f1e6d81b47b2a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-TestMinimumBasicScenario-393187960 Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 069626c3525d47a9b67f1e6d81b47b2a Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-TestMinimumBasicScenario-393187960 Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-TestMinimumBasicScenario-393187960-project Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: a7a959e57e0c4713a855844645fdc26a Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-TestMinimumBasicScenario-393187960-project Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 could not be found. Sep 28 15:51:38.833686 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '7d62c070-226f-4632-afcc-8b89ec928ef2'} Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 could not be found. Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:51:38.835249 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 could not be found. Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 could not be found. Sep 28 15:51:38.836657 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:51:38.838862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Returning 404 to user: Instance 7d62c070-226f-4632-afcc-8b89ec928ef2 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:51:38.838862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-5d292a41-0e33-44e6-9e12-a78f5de55b65 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2" status: 404 len: 111 microversion: 2.1 time: 0.032582 Sep 28 15:51:38.838862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 521/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:38 2022] GET /compute/v2.1/servers/7d62c070-226f-4632-afcc-8b89ec928ef2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:51:38.842862 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4cc392ae-525b-4b98-98fb-c1e711d774e2 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] Calling method '.version_select at 0x7f1154dfd5e0>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:38.865032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4cc392ae-525b-4b98-98fb-c1e711d774e2 tempest-TestMinimumBasicScenario-393187960 tempest-TestMinimumBasicScenario-393187960-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-678405601" status: 202 len: 0 microversion: 2.1 time: 0.026028 Sep 28 15:51:38.865669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 513/1034] 10.222.0.52 () {58 vars in 1269 bytes} [Wed Sep 28 15:51:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-678405601 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:51:38.996011 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:38.996762 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:39.003036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:39.003587 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:39.004094 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:39.004813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:39.005407 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:39.005680 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:39.168468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:39.176798 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a6537ab9-b69f-4ebb-81d2-2f71f9414542 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.184790 Sep 28 15:51:39.177378 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 522/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:38 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:40.200381 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:40.200983 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:40.207965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:40.208456 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:40.208943 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:40.209596 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:40.210149 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:40.210574 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:40.437635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:40.445649 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-3294b873-e55d-47c7-9feb-b19306e38509 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.249808 Sep 28 15:51:40.446339 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 514/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:40 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:41.474756 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:41.475383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:41.490725 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:41.491222 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:41.491660 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:41.492539 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:41.493031 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:41.493615 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:41.647465 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:41.655990 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9c4b6191-80e2-41ea-921f-41a7523a8fdf tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.187483 Sep 28 15:51:41.656566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 523/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:41 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:42.692477 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:42.693081 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:42.700499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.701269 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.701406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:42.702106 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:42.702557 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:42.702975 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:43.182323 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:43.189964 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e89e0222-d942-484f-b199-1b136138f21a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.501293 Sep 28 15:51:43.190534 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 515/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:42 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:44.214734 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:44.215386 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:44.221913 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:44.222402 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:44.222829 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:44.223523 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:44.223978 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:44.224406 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:44.374666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:44.383097 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-a502bba2-c9b2-42fe-9472-d7b7a22126f7 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.172169 Sep 28 15:51:44.384287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 524/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:44 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:45.405764 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:45.406400 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:45.408864 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:45.422505 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:45.423012 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:45.423652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:45.424669 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:45.425296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:45.425918 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:45.581141 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:45.590645 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-af21c682-fb9c-47e6-8b2d-2df4c5716b0f tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.188661 Sep 28 15:51:45.591245 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 516/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:45 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:46.614500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:46.615113 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:46.617447 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:51:46.623895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:46.624384 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:46.624817 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:46.625520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:46.625999 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:46.626426 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:46.770638 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:46.778482 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-07bc69b6-a88d-4e7d-b90a-f3b1ba93049c tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.168084 Sep 28 15:51:46.779053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 525/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:46 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:47.801750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:47.802445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:47.809418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:47.809938 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:47.810380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:47.811076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:47.811536 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:47.811960 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:47.944998 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:47.953747 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-85a92de3-4a82-4615-a753-7a144d644e15 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.155803 Sep 28 15:51:47.954353 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 517/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:47 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:51:48.049761 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-edadea75-c8a1-4426-b642-54e0f74c083e req-ef3575e4-9905-47d1-87fb-e1c24a207ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "name": "network-vif-plugged", "status": "completed", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:51:48.060952 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-edadea75-c8a1-4426-b642-54e0f74c083e req-ef3575e4-9905-47d1-87fb-e1c24a207ea7 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:48.061466 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-edadea75-c8a1-4426-b642-54e0f74c083e req-ef3575e4-9905-47d1-87fb-e1c24a207ea7 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:48.061996 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-edadea75-c8a1-4426-b642-54e0f74c083e req-ef3575e4-9905-47d1-87fb-e1c24a207ea7 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:48.074612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-edadea75-c8a1-4426-b642-54e0f74c083e req-ef3575e4-9905-47d1-87fb-e1c24a207ea7 service nova] Creating event network-vif-plugged:c78f0be5-1345-49e1-9c04-e28beb7e2fa7 for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 on hv-cinder-85931 Sep 28 15:51:48.079691 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-edadea75-c8a1-4426-b642-54e0f74c083e req-ef3575e4-9905-47d1-87fb-e1c24a207ea7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Sep 28 15:51:48.080341 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 526/1043] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:51:48.976525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:48.977131 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:48.984463 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:48.984942 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:48.985370 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:48.986082 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:48.986532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:48.986949 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:49.118253 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:49.125935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-a33641c7-8fab-4e25-b542-f5f6621babf4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1576 microversion: 2.1 time: 0.153263 Sep 28 15:51:49.126491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 518/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:48 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:51:50.148985 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:51:50.149673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:51:50.156353 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:50.156825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:50.157252 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:50.157960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:51:50.158414 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:51:50.158837 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:51:50.286217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:51:50.294624 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fc953d7b-ed3b-46fa-9a34-dfc740043c5a tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1563 microversion: 2.1 time: 0.149802 Sep 28 15:51:50.295195 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 527/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:51:50 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:12.290652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:12.291502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:12.293497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=5 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:12.294169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=48 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:12.299514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:12.299994 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:12.300424 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:12.301152 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:12.301601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:12.302048 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:12.327624 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Going to try to terminate instance {{(pid=127073) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:52:12.400523 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-f81db48a-c5d1-445f-81fa-a17b29fc11e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 204 len: 0 microversion: 2.1 time: 0.113676 Sep 28 15:52:12.401219 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 519/1046] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:52:12 2022] DELETE /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:52:12.409592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:12.410237 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:12.412814 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 28 15:52:12.413683 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=5 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:12.414358 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=42 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:12.420699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:12.421185 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:12.421621 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:12.422369 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:12.422823 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:12.423248 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:12.552093 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:12.560524 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8de3bbec-fac2-44ae-ae6e-a18195ae9882 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1578 microversion: 2.1 time: 0.154757 Sep 28 15:52:12.561108 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 528/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:12 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:13.584276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:13.584975 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:13.592070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:13.592552 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:13.592989 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:13.593683 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:13.594160 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:13.594581 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:13.735544 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:13.743907 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-be2ed5f2-8ec6-4f46-992e-1a7c3dd76691 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1578 microversion: 2.1 time: 0.163841 Sep 28 15:52:13.744467 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 520/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:13 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:14.770768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:14.771440 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:14.780184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:14.781666 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:14.782333 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:14.783459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:14.784147 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:14.784846 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:14.864770 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:14.874520 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d247c04b-c5c6-4d70-88c9-20389f936de5 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 200 len: 1511 microversion: 2.1 time: 0.109722 Sep 28 15:52:14.875963 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 529/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:14 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 1511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:15.036418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-836b2378-b99c-4ca9-888b-b131f290188f req-a632dcc6-2b91-4263-a39d-6586c13f06fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77c8bf17-ac25-4fa7-a79d-521d43b9902c", "name": "network-vif-deleted", "tag": "b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:15.054237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-836b2378-b99c-4ca9-888b-b131f290188f req-a632dcc6-2b91-4263-a39d-6586c13f06fd service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:15.054237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-836b2378-b99c-4ca9-888b-b131f290188f req-a632dcc6-2b91-4263-a39d-6586c13f06fd service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:15.054237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-836b2378-b99c-4ca9-888b-b131f290188f req-a632dcc6-2b91-4263-a39d-6586c13f06fd service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:15.064278 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-836b2378-b99c-4ca9-888b-b131f290188f req-a632dcc6-2b91-4263-a39d-6586c13f06fd service nova] Creating event network-vif-deleted:b2a2b1dc-8e64-4ac1-88f5-e7ff5c4b148b for instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c on hv-cinder-85931 Sep 28 15:52:15.069459 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-836b2378-b99c-4ca9-888b-b131f290188f req-a632dcc6-2b91-4263-a39d-6586c13f06fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264637 Sep 28 15:52:15.074676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 521/1050] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:52:15.900699 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:15.901227 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:15.907804 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:15.908285 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:15.908717 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:15.909417 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:15.909892 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:15.910316 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:15.925631 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] HTTP exception thrown: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Request method failure captured: Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c HTTP/1.1 Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNG0G_Sr0czRGPWrgxz9htjB4vms6hb2jCXuO8xeX5kbl3SA0heL_f6BOnqtMSSkQjfw1fknGak_j1niqcrZkGJMb7Z__85lTudzRR2V8kQDAgW9OGq0hT-cx3OCtWpU4-M8_9G0lUWK1YkxP2lvuN2aVb__N-snvp8e_c3NOdcN-66I Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:52:15.928307 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35cf5a9c74e44a918e45867c6570aa11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-TestVolumeBootPattern-755827502 Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 5fac9ab7665b4f14936adea96ae22ec4 Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:52:15.930143 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '77c8bf17-ac25-4fa7-a79d-521d43b9902c'} Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:52:15.931255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:52:15.932612 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:52:15.934067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Returning 404 to user: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:52:15.934067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-2c0b5dbc-9819-4b93-a278-b070468bcc72 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 404 len: 111 microversion: 2.1 time: 0.034050 Sep 28 15:52:15.934067 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 530/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:15 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:52:16.065607 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-891157078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866724906", "security_groups": [{"name": "tempest-secgroup-smoke-984375930"}], "block_device_mapping_v2": [{"uuid": "1b4cbebc-03f2-4c8b-b11e-5fe6bb67cd19", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb9fb97-d7e5-4300-bbd7-06e3c43ead21"}]}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:16.184142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] validate_networks() for [('3cb9fb97-d7e5-4300-bbd7-06e3c43ead21', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:52:16.567179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:52:16.567604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:52:16.568108 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:52:16.568511 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:52:16.568920 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:52:16.579190 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:16.579675 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:16.580110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:16.580841 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:16.581293 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:16.581717 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:16.606162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:52:16.611296 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for user 5fac9ab7665b4f14936adea96ae22ec4 and project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:52:16.678951 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:52:16.682010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b4cbebc-03f2-4c8b-b11e-5fe6bb67cd19',volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:52:16.812860 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-98191448-6d05-45ba-b1a0-47c71bcdafcc tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751530 Sep 28 15:52:16.813651 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 522/1052] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:52:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:52:16.826082 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-82c65877-eebd-43a0-bc17-be0921023251 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:16.826618 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-82c65877-eebd-43a0-bc17-be0921023251 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:16.884644 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-82c65877-eebd-43a0-bc17-be0921023251 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:16.891646 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-82c65877-eebd-43a0-bc17-be0921023251 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1094 microversion: 2.1 time: 0.069507 Sep 28 15:52:16.892224 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 531/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:16 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:17.915377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:17.916174 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:17.924466 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:17.925330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:17.925491 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:17.926146 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:17.926605 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:17.927038 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:18.036742 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:18.045503 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0bf40a75-4095-418a-993a-8eb3afd47c79 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1200 microversion: 2.1 time: 0.134791 Sep 28 15:52:18.046373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 523/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:17 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1200 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:19.074053 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:19.075153 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:19.088847 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:19.089750 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:19.090555 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:19.091946 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:19.092900 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:19.093793 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:19.334063 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:19.342549 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d9d5d7f2-7f13-415f-ad97-c26fdde41cf4 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.275825 Sep 28 15:52:19.343129 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 532/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:19 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:19.865099 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-ca24d26c-2a97-42f4-ba08-028d7c658a10 req-263c787b-0ef4-491c-952d-70fb4f311701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e12cc6-8052-4159-a0ef-404b1a75038a", "tag": "ecdc939d-9c3a-4306-9281-044d692d5dfd"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:19.878860 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-ca24d26c-2a97-42f4-ba08-028d7c658a10 req-263c787b-0ef4-491c-952d-70fb4f311701 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:19.879351 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-ca24d26c-2a97-42f4-ba08-028d7c658a10 req-263c787b-0ef4-491c-952d-70fb4f311701 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:19.879784 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-ca24d26c-2a97-42f4-ba08-028d7c658a10 req-263c787b-0ef4-491c-952d-70fb4f311701 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:19.893263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-ca24d26c-2a97-42f4-ba08-028d7c658a10 req-263c787b-0ef4-491c-952d-70fb4f311701 service nova] Creating event network-changed:ecdc939d-9c3a-4306-9281-044d692d5dfd for instance 91e12cc6-8052-4159-a0ef-404b1a75038a on hv-cinder-85931 Sep 28 15:52:19.898423 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-ca24d26c-2a97-42f4-ba08-028d7c658a10 req-263c787b-0ef4-491c-952d-70fb4f311701 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037385 Sep 28 15:52:19.899129 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 524/1056] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:52:20.366821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:20.367478 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:20.374415 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:20.374895 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:20.375329 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:20.376042 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:20.376495 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:20.376917 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:20.546305 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:20.554204 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d95b7315-d281-40f1-ba58-5e08a915e585 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.191262 Sep 28 15:52:20.554820 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 533/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:20 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:21.578676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:21.579387 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:21.586094 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:21.586835 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:21.587277 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:21.587979 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:21.588435 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:21.588860 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:21.731349 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:21.739486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c1b96c18-6900-4ed8-a2bc-44a99f898fb1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.165028 Sep 28 15:52:21.740049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 525/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:21 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:22.764209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:22.764815 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:22.771451 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:22.771921 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:22.772356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:22.773055 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:22.773509 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:22.773960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:22.912743 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:22.920748 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f38e2c6f-657b-4694-9bff-ee9db48304c8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.160381 Sep 28 15:52:22.921335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 534/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:22 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:23.944010 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:23.946426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:23.951935 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:23.952414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:23.952842 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:23.953535 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:23.954024 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:23.954445 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:24.082710 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:24.090984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-19db3491-9208-4416-8ff9-86fad2efd72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.150864 Sep 28 15:52:24.091546 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 526/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:23 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:25.115604 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:25.116215 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:25.122853 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:25.123335 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:25.123765 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:25.124461 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:25.124908 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:25.125323 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:25.262502 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:25.270471 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fcb398c6-2312-4362-9fd6-b64bfc4ba4c9 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.158677 Sep 28 15:52:25.271052 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 535/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:25 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:26.294829 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:26.295448 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:26.302034 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:26.302516 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:26.302963 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:26.303652 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:26.304101 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:26.305088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:26.433542 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:26.441178 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e4157a52-cb87-451b-ba5d-4ea096002c6d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.150431 Sep 28 15:52:26.441733 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 527/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:26 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:27.463983 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:27.464574 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:27.466961 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:27.472380 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:27.472865 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:27.473326 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:27.474054 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:27.474513 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:27.474937 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:27.612951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:27.621493 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0a4aa7b5-1005-497f-b302-a52750c4cac3 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.161394 Sep 28 15:52:27.622108 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 536/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:27 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:28.645206 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:28.646405 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:28.650194 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:28.651056 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:52:28.657273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:28.657831 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:28.658237 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:28.667967 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:28.668497 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:28.668984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:28.814276 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:28.822560 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-421a2ebb-a019-4bcc-87cc-dc8175655743 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.182136 Sep 28 15:52:28.823118 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 528/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:28 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:29.845311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:29.845988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:29.852554 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:29.853037 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:29.853470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:29.854208 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:29.854673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:29.855350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:29.991442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:29.999256 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d04e1383-11e8-45c3-89ff-095755595653 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.157877 Sep 28 15:52:29.999833 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 537/1065] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:29 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:30.299295 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-152df706-cc5a-4606-a60e-e6a6e5eef59f req-fd36c592-f8e9-4da4-a007-142f213f548a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e12cc6-8052-4159-a0ef-404b1a75038a", "name": "network-vif-plugged", "status": "completed", "tag": "ecdc939d-9c3a-4306-9281-044d692d5dfd"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:30.310221 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-152df706-cc5a-4606-a60e-e6a6e5eef59f req-fd36c592-f8e9-4da4-a007-142f213f548a service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:30.310715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-152df706-cc5a-4606-a60e-e6a6e5eef59f req-fd36c592-f8e9-4da4-a007-142f213f548a service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:30.311151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-152df706-cc5a-4606-a60e-e6a6e5eef59f req-fd36c592-f8e9-4da4-a007-142f213f548a service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:30.324099 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-152df706-cc5a-4606-a60e-e6a6e5eef59f req-fd36c592-f8e9-4da4-a007-142f213f548a service nova] Creating event network-vif-plugged:ecdc939d-9c3a-4306-9281-044d692d5dfd for instance 91e12cc6-8052-4159-a0ef-404b1a75038a on hv-cinder-85931 Sep 28 15:52:30.329096 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-152df706-cc5a-4606-a60e-e6a6e5eef59f req-fd36c592-f8e9-4da4-a007-142f213f548a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033547 Sep 28 15:52:30.329706 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 529/1066] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:52:31.022673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:31.023720 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:31.030235 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:31.030727 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:31.031164 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:31.031863 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:31.032317 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:31.032741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:31.177401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:31.185728 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-813477cb-c621-4178-b06a-87e907b7e245 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1265 microversion: 2.1 time: 0.166923 Sep 28 15:52:31.186327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 538/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:31 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:32.209782 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:32.210502 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:32.216906 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:32.217389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:32.217820 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:32.218545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:32.218991 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:32.219410 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:32.360363 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:32.368151 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d81dbb04-0d66-4b23-8192-6d9b7da8071a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1452 microversion: 2.1 time: 0.163059 Sep 28 15:52:32.368715 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 530/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:32 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:32.390951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:52:32.391558 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:52:32.398542 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:32.399027 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:32.399459 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:32.400156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:32.400610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:32.401035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:32.535921 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:52:32.544404 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-56d7ce90-f173-438a-bfad-5ee38c7cd09a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1452 microversion: 2.1 time: 0.157435 Sep 28 15:52:32.544972 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 539/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:52:32 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:52:34.413142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-a1a024af-254f-4e8d-a6fb-1a436ba21839 req-36ec2697-3b11-420d-bfae-7a05777f14f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e12cc6-8052-4159-a0ef-404b1a75038a", "tag": "ecdc939d-9c3a-4306-9281-044d692d5dfd"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:52:34.423260 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-a1a024af-254f-4e8d-a6fb-1a436ba21839 req-36ec2697-3b11-420d-bfae-7a05777f14f2 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:52:34.423743 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-a1a024af-254f-4e8d-a6fb-1a436ba21839 req-36ec2697-3b11-420d-bfae-7a05777f14f2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:52:34.424172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-a1a024af-254f-4e8d-a6fb-1a436ba21839 req-36ec2697-3b11-420d-bfae-7a05777f14f2 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:52:34.435429 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-a1a024af-254f-4e8d-a6fb-1a436ba21839 req-36ec2697-3b11-420d-bfae-7a05777f14f2 service nova] Creating event network-changed:ecdc939d-9c3a-4306-9281-044d692d5dfd for instance 91e12cc6-8052-4159-a0ef-404b1a75038a on hv-cinder-85931 Sep 28 15:52:34.440171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-a1a024af-254f-4e8d-a6fb-1a436ba21839 req-36ec2697-3b11-420d-bfae-7a05777f14f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094031 Sep 28 15:52:34.440775 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 531/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:53:07.019398 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:07.020044 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:07.022801 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=26 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:07.026337 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:07.027083 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:07.031055 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-fd24c285-56dd-451b-bad6-4a2acd2fb97b req-b0e3c6ef-9f2e-4c4c-935c-dfd3f53da817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:53:07.034197 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=62 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:53:07.040804 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:07.041296 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:07.041733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:07.042469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:07.042950 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:07.043381 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:07.054162 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-fd24c285-56dd-451b-bad6-4a2acd2fb97b req-b0e3c6ef-9f2e-4c4c-935c-dfd3f53da817 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:07.054965 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-fd24c285-56dd-451b-bad6-4a2acd2fb97b req-b0e3c6ef-9f2e-4c4c-935c-dfd3f53da817 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:07.055718 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-fd24c285-56dd-451b-bad6-4a2acd2fb97b req-b0e3c6ef-9f2e-4c4c-935c-dfd3f53da817 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:07.068298 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-fd24c285-56dd-451b-bad6-4a2acd2fb97b req-b0e3c6ef-9f2e-4c4c-935c-dfd3f53da817 service nova] Creating event network-changed:c78f0be5-1345-49e1-9c04-e28beb7e2fa7 for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 on hv-cinder-85931 Sep 28 15:53:07.073584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-fd24c285-56dd-451b-bad6-4a2acd2fb97b req-b0e3c6ef-9f2e-4c4c-935c-dfd3f53da817 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048652 Sep 28 15:53:07.074489 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 532/1071] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:53:07.076290 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:53:07.161741 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1984ff1f-cf32-4ad4-b2e7-09acf9cac699 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 204 len: 0 microversion: 2.1 time: 0.145203 Sep 28 15:53:07.163293 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 540/1072] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:53:07 2022] DELETE /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:53:07.172436 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:07.173936 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:07.182944 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:07.183663 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:07.184169 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:07.184933 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:07.185473 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:07.186007 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:07.355005 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:07.362666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-54a4b288-d90c-422f-af21-6ca3995af358 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.194905 Sep 28 15:53:07.377881 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 533/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:53:07 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:53:08.386565 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:08.387388 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:08.393704 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:08.394217 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:08.394645 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:08.397111 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:08.397111 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:08.397111 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:08.571194 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:08.579050 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7d8d41dd-95ea-4dc0-92cb-b2c15d5e47c4 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1569 microversion: 2.1 time: 0.196762 Sep 28 15:53:08.579610 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 541/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:53:08 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:53:09.167179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-e44ccbb1-9655-4f47-beda-5baec3477a50 req-f16cd326-d440-4258-a23b-10e768b9c1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa1934f-5f8a-41af-87d3-1b39d2b921c9", "name": "network-vif-deleted", "tag": "c78f0be5-1345-49e1-9c04-e28beb7e2fa7"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:53:09.179375 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-e44ccbb1-9655-4f47-beda-5baec3477a50 req-f16cd326-d440-4258-a23b-10e768b9c1cc service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:09.179850 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-e44ccbb1-9655-4f47-beda-5baec3477a50 req-f16cd326-d440-4258-a23b-10e768b9c1cc service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:09.180273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-e44ccbb1-9655-4f47-beda-5baec3477a50 req-f16cd326-d440-4258-a23b-10e768b9c1cc service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:09.191904 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-e44ccbb1-9655-4f47-beda-5baec3477a50 req-f16cd326-d440-4258-a23b-10e768b9c1cc service nova] Creating event network-vif-deleted:c78f0be5-1345-49e1-9c04-e28beb7e2fa7 for instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 on hv-cinder-85931 Sep 28 15:53:09.198235 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-e44ccbb1-9655-4f47-beda-5baec3477a50 req-f16cd326-d440-4258-a23b-10e768b9c1cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034536 Sep 28 15:53:09.198830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 534/1075] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:53:09.603156 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:09.604046 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:09.610673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:09.611145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:09.611783 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:09.612473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:09.612922 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:09.613344 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:09.648469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:09.648952 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:09.649385 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:09.649880 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lazy-loading 'fault' on Instance uuid 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:53:09.691856 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a6ab5102034cc68a60218d0d434f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1bf756bfcb4d52bd82979559f03a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:53:09.699763 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c190db99-c0e8-4f14-9868-a7bf52228740 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 200 len: 1224 microversion: 2.1 time: 0.100914 Sep 28 15:53:09.700327 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 542/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:53:09 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:53:10.723395 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:10.724111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] [instance: 5fa1934f-5f8a-41af-87d3-1b39d2b921c9] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:53:10.731043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:10.731519 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:10.731941 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:10.732635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:53:10.733085 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:53:10.733509 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:53:10.747099 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] HTTP exception thrown: Instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 could not be found. Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Request method failure captured: Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 HTTP/1.1 Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNGzNxqDHKaCb4Jmtpl7kvg-QHp7PvR5SQ9Lfc72Xdd6XZDW0rfeP4c_hLsByuiA9fKeYuvZI7c1zqZFzi6LwugLJ0XCqAkJq4vywUP1B_XVImHDZ4Xt83aKCn3ECBpML18zfgcU46Babskp6m_RF_CbcOE0RsGR0Y0gBvFXD98GhcAE Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: ed1bf756bfcb4d52bd82979559f03a20 Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-TestShelveInstance-1993423946 Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:53:10.748724 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed1bf756bfcb4d52bd82979559f03a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ed1bf756bfcb4d52bd82979559f03a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ed1bf756bfcb4d52bd82979559f03a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ed1bf756bfcb4d52bd82979559f03a20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-TestShelveInstance-1993423946 Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: ed1bf756bfcb4d52bd82979559f03a20 Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-TestShelveInstance-1993423946 Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-TestShelveInstance-1993423946-project Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 55a6ab5102034cc68a60218d0d434f25 Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-TestShelveInstance-1993423946-project Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 could not be found. Sep 28 15:53:10.750486 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '5fa1934f-5f8a-41af-87d3-1b39d2b921c9'} Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 could not be found. Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:53:10.751479 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 could not be found. Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 could not be found. Sep 28 15:53:10.754462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:53:10.757218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Returning 404 to user: Instance 5fa1934f-5f8a-41af-87d3-1b39d2b921c9 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:53:10.757218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-fd0f491d-1945-4c42-8e4c-44426c996fff tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9" status: 404 len: 111 microversion: 2.1 time: 0.030952 Sep 28 15:53:10.757218 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 535/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:53:10 2022] GET /compute/v2.1/servers/5fa1934f-5f8a-41af-87d3-1b39d2b921c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:53:10.911017 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-176b5e4d-731b-4cba-8eb3-567af4a2c215 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] Calling method '.version_select at 0x7f1154de9040>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:53:10.934778 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-176b5e4d-731b-4cba-8eb3-567af4a2c215 tempest-TestShelveInstance-1993423946 tempest-TestShelveInstance-1993423946-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-190392309" status: 202 len: 0 microversion: 2.1 time: 0.027497 Sep 28 15:53:10.939132 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 543/1078] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 15:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-190392309 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 15:54:11.221093 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=8 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:11.221830 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=12 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:11.223203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:54:11.223338 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Wed Sep 28 15:54:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Sep 28 15:54:11.228465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-837399188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1866724906", "security_groups": [{"name": "tempest-secgroup-smoke-984375930"}], "block_device_mapping_v2": [{"uuid": "bbf716a5-e9c4-4789-b20c-c1457b5c71c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb9fb97-d7e5-4300-bbd7-06e3c43ead21"}]}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:11.343773 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.network.neutron [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] validate_networks() for [('3cb9fb97-d7e5-4300-bbd7-06e3c43ead21', None, None, None, None, None)] {{(pid=127073) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 15:54:11.822545 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Flavor limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 15:54:11.822970 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Image limits 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 15:54:11.823446 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Flavor pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 15:54:11.823879 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Image pref 0:0:0 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 15:54:11.824294 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.virt.hardware [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 15:54:11.833231 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:11.833717 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:11.834192 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:11.834929 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:11.835389 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:11.835819 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:11.853790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 15:54:11.858484 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.quota [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Getting quotas for user 5fac9ab7665b4f14936adea96ae22ec4 and project 35cf5a9c74e44a918e45867c6570aa11. Resources: {'ram', 'instances', 'cores'} {{(pid=127073) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 15:54:11.914927 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Going to run 1 instances... {{(pid=127073) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 15:54:11.917072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbf716a5-e9c4-4789-b20c-c1457b5c71c4',volume_size=None,volume_type=None)] {{(pid=127073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 15:54:12.042900 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5bfbbb95-27ba-4412-8b6d-3b92990797d7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823441 Sep 28 15:54:12.043703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 536/1079] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 15:54:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 15:54:12.053315 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:12.054169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:12.060690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1c96a19d-2982-4f1b-b81c-d3b84c40622a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:12.061473 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1c96a19d-2982-4f1b-b81c-d3b84c40622a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:12.130811 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-1c96a19d-2982-4f1b-b81c-d3b84c40622a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:12.137885 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1c96a19d-2982-4f1b-b81c-d3b84c40622a tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1094 microversion: 2.1 time: 0.086592 Sep 28 15:54:12.138455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 544/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:12 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:13.161676 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:13.162329 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:13.169343 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:13.169883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:13.170327 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:13.171247 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:13.172817 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:13.173514 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:13.278138 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:13.288215 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d709f2f9-7619-4804-aa70-8e1746c33103 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1210 microversion: 2.1 time: 0.131351 Sep 28 15:54:13.288802 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 537/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:13 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:14.312476 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:14.313721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:14.320993 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:14.321489 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:14.321954 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:14.322684 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:14.323145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:14.323575 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:14.531975 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:14.540742 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ea213710-789b-40d6-a652-3d9b380ca95b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.232091 Sep 28 15:54:14.541514 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 545/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:14 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:14.907440 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-552c5915-b026-4667-a447-19fdfe94ea63 req-01b9aa9d-f6eb-4f5a-9df7-e19a629f946c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939549b8-a997-4e5b-8ba9-51578c48a50c", "tag": "169aac61-21a4-459f-b83e-aea81c2fc805"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:14.918211 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-552c5915-b026-4667-a447-19fdfe94ea63 req-01b9aa9d-f6eb-4f5a-9df7-e19a629f946c service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:14.918666 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-552c5915-b026-4667-a447-19fdfe94ea63 req-01b9aa9d-f6eb-4f5a-9df7-e19a629f946c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:14.919092 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-552c5915-b026-4667-a447-19fdfe94ea63 req-01b9aa9d-f6eb-4f5a-9df7-e19a629f946c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:14.931592 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-552c5915-b026-4667-a447-19fdfe94ea63 req-01b9aa9d-f6eb-4f5a-9df7-e19a629f946c service nova] Creating event network-changed:169aac61-21a4-459f-b83e-aea81c2fc805 for instance 939549b8-a997-4e5b-8ba9-51578c48a50c on hv-cinder-85931 Sep 28 15:54:14.936428 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-552c5915-b026-4667-a447-19fdfe94ea63 req-01b9aa9d-f6eb-4f5a-9df7-e19a629f946c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034129 Sep 28 15:54:14.937016 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 538/1083] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:54:15.565766 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:15.566401 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:15.573302 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:15.573794 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:15.574262 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:15.575013 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:15.575464 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:15.575885 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:15.823721 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:15.832642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e9dcdffa-f7ab-4ac6-97ae-676d303b089f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.271641 Sep 28 15:54:15.833238 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 546/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:15 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:16.857278 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:16.859766 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:16.864716 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:16.865203 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:16.865882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:16.866601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:16.867049 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:16.867465 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:17.006532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:17.015501 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-abcb92af-9868-4a18-b70d-12f3625de72b tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.162968 Sep 28 15:54:17.016692 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 539/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:16 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:18.039184 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:18.039795 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:18.046291 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:18.047289 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:18.047733 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:18.048419 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:18.048867 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:18.049283 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:18.178931 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:18.186642 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-f78a85f6-10c2-4e54-b758-fd1146d33b09 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.151379 Sep 28 15:54:18.187350 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 547/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:18 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:19.208672 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:19.209263 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:19.215598 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:19.216072 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:19.216691 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:19.217377 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:19.217823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:19.218262 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:19.351539 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:19.359179 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-91d17f4c-e911-4430-a0cd-3dc69f3c28c0 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.154488 Sep 28 15:54:19.360248 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 540/1087] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:19 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:20.382188 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:20.382805 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:20.389294 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:20.389777 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:20.390246 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:20.390960 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:20.391396 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:20.391821 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:20.519310 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:20.527145 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-bf01ad27-f688-4324-87d5-832dd31a49ad tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.148900 Sep 28 15:54:20.527731 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 548/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:20 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:21.550386 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:21.550995 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:21.557330 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:21.557808 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:21.558265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:21.558946 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:21.559392 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:21.559811 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:21.692887 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:21.700507 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1ab665b6-4510-457d-a248-0e3a2283e509 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.154703 Sep 28 15:54:21.701064 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 541/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:21 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:22.722813 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:22.723419 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:22.726036 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=2 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:22.731532 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:22.732010 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:22.732470 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:22.733162 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:22.733609 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:22.734544 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:22.866598 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:22.875141 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-cb7ac52a-b075-4065-8331-e435cb7cb5cf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.155687 Sep 28 15:54:22.875714 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 549/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:22 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:23.899171 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:23.899789 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:23.901745 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=2 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:23.902584 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:54:23.908604 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:23.909091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:23.909522 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:23.910265 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:23.910723 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:23.911145 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:24.040041 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:24.047678 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9041bfdb-ab27-41d6-9cd7-f914a6efbae6 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.153210 Sep 28 15:54:24.048242 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 542/1091] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:23 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:25.071439 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:25.073043 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:25.080586 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:25.081355 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:25.081790 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:25.082532 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:25.082988 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:25.083414 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:25.162843 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [req-def5d237-1d62-480e-a3fa-747d7659f5ea req-0705630c-bd39-4c9e-a06c-4429493a2d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939549b8-a997-4e5b-8ba9-51578c48a50c", "name": "network-vif-plugged", "status": "completed", "tag": "169aac61-21a4-459f-b83e-aea81c2fc805"}]} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:25.172383 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-def5d237-1d62-480e-a3fa-747d7659f5ea req-0705630c-bd39-4c9e-a06c-4429493a2d7e service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:25.172857 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-def5d237-1d62-480e-a3fa-747d7659f5ea req-0705630c-bd39-4c9e-a06c-4429493a2d7e service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:25.173287 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [req-def5d237-1d62-480e-a3fa-747d7659f5ea req-0705630c-bd39-4c9e-a06c-4429493a2d7e service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:25.184274 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.compute.server_external_events [req-def5d237-1d62-480e-a3fa-747d7659f5ea req-0705630c-bd39-4c9e-a06c-4429493a2d7e service nova] Creating event network-vif-plugged:169aac61-21a4-459f-b83e-aea81c2fc805 for instance 939549b8-a997-4e5b-8ba9-51578c48a50c on hv-cinder-85931 Sep 28 15:54:25.190348 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [req-def5d237-1d62-480e-a3fa-747d7659f5ea req-0705630c-bd39-4c9e-a06c-4429493a2d7e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163460 Sep 28 15:54:25.190941 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 550/1092] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:54:25.233886 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:25.241485 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-de66d30b-140b-4125-b33a-f92c571a9f95 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.174731 Sep 28 15:54:25.242080 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 543/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:25 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:54:26.266490 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:26.267099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:26.273345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:26.273836 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:26.274299 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:26.275003 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:26.275456 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:26.275882 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:26.412363 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:26.420081 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-879194a2-b03d-4145-a845-787d9909c413 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1265 microversion: 2.1 time: 0.159046 Sep 28 15:54:26.420647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 551/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:26 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:27.443889 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:27.444496 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:27.450945 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.451434 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.451867 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.453337 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.454066 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.454510 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.602333 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:27.610091 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-23ecae74-3220-4587-9500-8cd4e6b29d73 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1453 microversion: 2.1 time: 0.170077 Sep 28 15:54:27.610660 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 544/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:27 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:27.633155 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:54:27.633768 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:54:27.640951 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.641442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.641903 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.642879 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:27.643071 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:27.643503 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:27.779690 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:54:27.788021 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8618ca06-a69c-4b82-8f03-25c077f4952c tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1453 microversion: 2.1 time: 0.158797 Sep 28 15:54:27.788608 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 552/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:54:27 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:54:29.642368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-71208e10-962f-49c2-9d4d-219ac99e0411 req-c43ecc63-7b18-47f3-9336-1a5015fffe33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939549b8-a997-4e5b-8ba9-51578c48a50c", "tag": "169aac61-21a4-459f-b83e-aea81c2fc805"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:54:29.652120 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-71208e10-962f-49c2-9d4d-219ac99e0411 req-c43ecc63-7b18-47f3-9336-1a5015fffe33 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:54:29.652610 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-71208e10-962f-49c2-9d4d-219ac99e0411 req-c43ecc63-7b18-47f3-9336-1a5015fffe33 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:54:29.653046 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-71208e10-962f-49c2-9d4d-219ac99e0411 req-c43ecc63-7b18-47f3-9336-1a5015fffe33 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:54:29.665255 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-71208e10-962f-49c2-9d4d-219ac99e0411 req-c43ecc63-7b18-47f3-9336-1a5015fffe33 service nova] Creating event network-changed:169aac61-21a4-459f-b83e-aea81c2fc805 for instance 939549b8-a997-4e5b-8ba9-51578c48a50c on hv-cinder-85931 Sep 28 15:54:29.671740 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-71208e10-962f-49c2-9d4d-219ac99e0411 req-c43ecc63-7b18-47f3-9336-1a5015fffe33 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032105 Sep 28 15:54:29.672368 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 545/1097] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:55:59.917356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=20 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:59.918211 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=44 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:59.921882 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:59.922615 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=48 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 15:55:59.925157 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:55:59.925304 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Wed Sep 28 15:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c (ip 10.222.0.52) !!! Sep 28 15:55:59.929823 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-3c7e55f9-c18c-4dde-9f62-b99f0c4f7f7e req-1e066cfa-3e4d-41bd-bcd5-9777c3524578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939549b8-a997-4e5b-8ba9-51578c48a50c", "tag": "169aac61-21a4-459f-b83e-aea81c2fc805"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:55:59.931677 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 15:55:59.931803 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Wed Sep 28 15:55:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c (ip 10.222.0.52) !!! Sep 28 15:55:59.937825 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:55:59.938469 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:55:59.957209 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:59.957669 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:59.958136 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:59.958841 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:59.959306 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:59.959942 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:59.964704 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-3c7e55f9-c18c-4dde-9f62-b99f0c4f7f7e req-1e066cfa-3e4d-41bd-bcd5-9777c3524578 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:55:59.965172 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-3c7e55f9-c18c-4dde-9f62-b99f0c4f7f7e req-1e066cfa-3e4d-41bd-bcd5-9777c3524578 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:55:59.965601 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-3c7e55f9-c18c-4dde-9f62-b99f0c4f7f7e req-1e066cfa-3e4d-41bd-bcd5-9777c3524578 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:55:59.980070 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-3c7e55f9-c18c-4dde-9f62-b99f0c4f7f7e req-1e066cfa-3e4d-41bd-bcd5-9777c3524578 service nova] Creating event network-changed:169aac61-21a4-459f-b83e-aea81c2fc805 for instance 939549b8-a997-4e5b-8ba9-51578c48a50c on hv-cinder-85931 Sep 28 15:55:59.986930 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-3c7e55f9-c18c-4dde-9f62-b99f0c4f7f7e req-1e066cfa-3e4d-41bd-bcd5-9777c3524578 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066863 Sep 28 15:55:59.987838 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 546/1098] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:55:59.996738 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:56:00.090614 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-8343ed3f-ed6c-4744-8ff9-3001fe8f483f tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 204 len: 0 microversion: 2.1 time: 0.175411 Sep 28 15:56:00.091647 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 553/1099] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:55:59 2022] DELETE /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 15:56:00.101404 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:00.102142 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:00.109700 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:00.110579 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:00.111032 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:00.111755 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:00.112366 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:00.112608 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:00.279437 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:00.287867 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c5ab6dce-b5be-478e-aff8-a8cab4da9a75 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1578 microversion: 2.1 time: 0.191500 Sep 28 15:56:00.288525 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 547/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:00 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:56:01.313212 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:01.313940 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:01.320588 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:01.321070 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:01.321596 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:01.322238 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:01.322694 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:01.323527 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:01.474277 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:01.481986 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-9f6bf391-de7a-4f21-be5d-bf1aceef8caf tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1578 microversion: 2.1 time: 0.173025 Sep 28 15:56:01.482551 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 554/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:01 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:56:02.133834 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-1bac4b76-67ab-4155-bfad-eda69c6ed763 req-465591d9-7de3-4553-a11e-a72295923f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939549b8-a997-4e5b-8ba9-51578c48a50c", "name": "network-vif-deleted", "tag": "169aac61-21a4-459f-b83e-aea81c2fc805"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:56:02.145154 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-1bac4b76-67ab-4155-bfad-eda69c6ed763 req-465591d9-7de3-4553-a11e-a72295923f8c service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:02.145635 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-1bac4b76-67ab-4155-bfad-eda69c6ed763 req-465591d9-7de3-4553-a11e-a72295923f8c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:02.146110 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-1bac4b76-67ab-4155-bfad-eda69c6ed763 req-465591d9-7de3-4553-a11e-a72295923f8c service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:02.159538 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-1bac4b76-67ab-4155-bfad-eda69c6ed763 req-465591d9-7de3-4553-a11e-a72295923f8c service nova] Creating event network-vif-deleted:169aac61-21a4-459f-b83e-aea81c2fc805 for instance 939549b8-a997-4e5b-8ba9-51578c48a50c on hv-cinder-85931 Sep 28 15:56:02.164365 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-1bac4b76-67ab-4155-bfad-eda69c6ed763 req-465591d9-7de3-4553-a11e-a72295923f8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 Sep 28 15:56:02.165160 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 548/1102] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 15:56:02.506244 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:02.507538 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:02.515862 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:02.516355 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:02.517019 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:02.518040 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:02.518497 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:02.518944 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:02.558001 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:02.558548 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:02.558988 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:02.559442 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lazy-loading 'fault' on Instance uuid 939549b8-a997-4e5b-8ba9-51578c48a50c {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:56:02.606719 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:02.614566 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-90a3770e-3dee-49dc-94d7-5b11f6c9873d tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 200 len: 1230 microversion: 2.1 time: 0.113725 Sep 28 15:56:02.615126 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 555/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:02 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 15:56:03.639107 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:03.639810 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 939549b8-a997-4e5b-8ba9-51578c48a50c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:03.645970 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:03.646450 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:03.646883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:03.647573 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:03.648028 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:03.648452 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:03.662426 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] HTTP exception thrown: Instance 939549b8-a997-4e5b-8ba9-51578c48a50c could not be found. Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Request method failure captured: Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c HTTP/1.1 Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNG0G_Sr0czRGPWrgxz9htjB4vms6hb2jCXuO8xeX5kbl3SA0heL_f6BOnqtMSSkQjfw1fknGak_j1niqcrZkGJMb7Z__85lTudzRR2V8kQDAgW9OGq0hT-cx3OCtWpU4-M8_9G0lUWK1YkxP2lvuN2aVb__N-snvp8e_c3NOdcN-66I Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:56:03.664088 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35cf5a9c74e44a918e45867c6570aa11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 5fac9ab7665b4f14936adea96ae22ec4 Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 939549b8-a997-4e5b-8ba9-51578c48a50c could not be found. Sep 28 15:56:03.667157 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '939549b8-a997-4e5b-8ba9-51578c48a50c'} Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939549b8-a997-4e5b-8ba9-51578c48a50c could not be found. Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:56:03.668462 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939549b8-a997-4e5b-8ba9-51578c48a50c could not be found. Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939549b8-a997-4e5b-8ba9-51578c48a50c could not be found. Sep 28 15:56:03.670150 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:03.672273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Returning 404 to user: Instance 939549b8-a997-4e5b-8ba9-51578c48a50c could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:56:03.672273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-11047c49-9b8a-453b-9359-b8627b70e954 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c" status: 404 len: 111 microversion: 2.1 time: 0.031099 Sep 28 15:56:03.672273 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 549/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:03 2022] GET /compute/v2.1/servers/939549b8-a997-4e5b-8ba9-51578c48a50c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:56:07.018675 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:07.019189 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:07.025035 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-6d70cbd6-98b5-49ca-8e03-8f26aac7b044 req-739aa5da-7ae1-47ea-9f45-4133b7cbb66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e12cc6-8052-4159-a0ef-404b1a75038a", "tag": "ecdc939d-9c3a-4306-9281-044d692d5dfd"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:56:07.025701 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:07.026187 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:07.026623 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:07.027728 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:07.028255 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:07.028682 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:07.037076 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-6d70cbd6-98b5-49ca-8e03-8f26aac7b044 req-739aa5da-7ae1-47ea-9f45-4133b7cbb66f service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:07.037753 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-6d70cbd6-98b5-49ca-8e03-8f26aac7b044 req-739aa5da-7ae1-47ea-9f45-4133b7cbb66f service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:07.038197 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-6d70cbd6-98b5-49ca-8e03-8f26aac7b044 req-739aa5da-7ae1-47ea-9f45-4133b7cbb66f service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:07.050587 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-6d70cbd6-98b5-49ca-8e03-8f26aac7b044 req-739aa5da-7ae1-47ea-9f45-4133b7cbb66f service nova] Creating event network-changed:ecdc939d-9c3a-4306-9281-044d692d5dfd for instance 91e12cc6-8052-4159-a0ef-404b1a75038a on hv-cinder-85931 Sep 28 15:56:07.056061 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-6d70cbd6-98b5-49ca-8e03-8f26aac7b044 req-739aa5da-7ae1-47ea-9f45-4133b7cbb66f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035149 Sep 28 15:56:07.056848 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 550/1105] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:56:07.060410 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Going to try to terminate instance {{(pid=127074) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 15:56:07.155400 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1273a605-a2e9-402f-8e9e-ca94b7f9e606 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 204 len: 0 microversion: 2.1 time: 0.141530 Sep 28 15:56:07.157008 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 556/1106] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:56:07 2022] DELETE /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 15:56:07.170418 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:07.171846 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:07.182763 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:07.183871 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:07.184560 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:07.186058 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:07.187133 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:07.187985 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:07.354750 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.policy [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127073) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:07.363054 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-08a5db60-1595-4fd9-8e7e-19d8ed71c2c7 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1577 microversion: 2.1 time: 0.200742 Sep 28 15:56:07.363633 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 551/1107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:07 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:56:08.388345 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:08.389059 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:08.396872 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:08.397356 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:08.397789 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:08.398650 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:08.399134 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:08.399589 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:08.556049 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:08.563864 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-c23f75db-99a2-4ad3-b420-96cf9efe5747 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1577 microversion: 2.1 time: 0.180555 Sep 28 15:56:08.564424 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 557/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:08 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:56:09.166373 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [req-c0761b72-56ff-4ace-8d4f-032e93f814ed req-2728a2f9-b01a-4894-b2b3-200e4acf2cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e12cc6-8052-4159-a0ef-404b1a75038a", "name": "network-vif-deleted", "tag": "ecdc939d-9c3a-4306-9281-044d692d5dfd"}]} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 15:56:09.176738 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c0761b72-56ff-4ace-8d4f-032e93f814ed req-2728a2f9-b01a-4894-b2b3-200e4acf2cf3 service nova] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:09.177301 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c0761b72-56ff-4ace-8d4f-032e93f814ed req-2728a2f9-b01a-4894-b2b3-200e4acf2cf3 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:09.178527 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [req-c0761b72-56ff-4ace-8d4f-032e93f814ed req-2728a2f9-b01a-4894-b2b3-200e4acf2cf3 service nova] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:09.191883 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.compute.server_external_events [req-c0761b72-56ff-4ace-8d4f-032e93f814ed req-2728a2f9-b01a-4894-b2b3-200e4acf2cf3 service nova] Creating event network-vif-deleted:ecdc939d-9c3a-4306-9281-044d692d5dfd for instance 91e12cc6-8052-4159-a0ef-404b1a75038a on hv-cinder-85931 Sep 28 15:56:09.197566 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [req-c0761b72-56ff-4ace-8d4f-032e93f814ed req-2728a2f9-b01a-4894-b2b3-200e4acf2cf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034833 Sep 28 15:56:09.198335 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 552/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 15:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 15:56:09.587787 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:09.588403 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:09.595263 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:09.595774 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:09.596599 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:09.597166 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:09.598392 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:09.598392 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:09.631641 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:09.632035 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:09.632468 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:09.632904 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.objects.instance [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lazy-loading 'fault' on Instance uuid 91e12cc6-8052-4159-a0ef-404b1a75038a {{(pid=127074) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 15:56:09.678390 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.policy [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fac9ab7665b4f14936adea96ae22ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35cf5a9c74e44a918e45867c6570aa11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127074) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 15:56:09.686592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-7df5337d-6a46-4399-99a8-3e8ca40b9596 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 200 len: 1230 microversion: 2.1 time: 0.102669 Sep 28 15:56:09.687098 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 558/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:09 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 15:56:10.710759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:10.711460 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 91e12cc6-8052-4159-a0ef-404b1a75038a] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:10.718230 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:10.718703 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:10.719130 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:10.719818 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:10.720266 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:10.720682 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:10.735027 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] HTTP exception thrown: Instance 91e12cc6-8052-4159-a0ef-404b1a75038a could not be found. Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Request method failure captured: Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a HTTP/1.1 Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNG0G_Sr0czRGPWrgxz9htjB4vms6hb2jCXuO8xeX5kbl3SA0heL_f6BOnqtMSSkQjfw1fknGak_j1niqcrZkGJMb7Z__85lTudzRR2V8kQDAgW9OGq0hT-cx3OCtWpU4-M8_9G0lUWK1YkxP2lvuN2aVb__N-snvp8e_c3NOdcN-66I Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:56:10.736670 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35cf5a9c74e44a918e45867c6570aa11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 5fac9ab7665b4f14936adea96ae22ec4 Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 91e12cc6-8052-4159-a0ef-404b1a75038a could not be found. Sep 28 15:56:10.738774 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '91e12cc6-8052-4159-a0ef-404b1a75038a'} Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e12cc6-8052-4159-a0ef-404b1a75038a could not be found. Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:56:10.740378 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e12cc6-8052-4159-a0ef-404b1a75038a could not be found. Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e12cc6-8052-4159-a0ef-404b1a75038a could not be found. Sep 28 15:56:10.742547 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:10.744125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Returning 404 to user: Instance 91e12cc6-8052-4159-a0ef-404b1a75038a could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:56:10.744125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-64ccd764-6ac1-4ad0-bce9-e72351684dff tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a" status: 404 len: 111 microversion: 2.1 time: 0.031728 Sep 28 15:56:10.744125 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 553/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:10 2022] GET /compute/v2.1/servers/91e12cc6-8052-4159-a0ef-404b1a75038a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:56:11.201556 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:11.202099 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.compute.api [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127074) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:11.208592 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:11.209069 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:11.209500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:11.210228 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:11.210673 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:11.211091 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:11.229455 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] HTTP exception thrown: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Request method failure captured: Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: request: DELETE /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c HTTP/1.1 Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept: application/json Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Accept-Encoding: identity Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Connection: close Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Length: 0 Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Content-Type: application/json Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Host: 10.222.0.52 Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: Openstack-System-Scope: None Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: User-Agent: python-urllib3/1.26.12 Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Auth-Token: gAAAAABjNG0G_Sr0czRGPWrgxz9htjB4vms6hb2jCXuO8xeX5kbl3SA0heL_f6BOnqtMSSkQjfw1fknGak_j1niqcrZkGJMb7Z__85lTudzRR2V8kQDAgW9OGq0hT-cx3OCtWpU4-M8_9G0lUWK1YkxP2lvuN2aVb__N-snvp8e_c3NOdcN-66I Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Id: None Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Domain-Name: None Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Identity-Status: Confirmed Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Is-Admin-Project: True Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Id: default Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Domain-Name: Default Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Project-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Role: reader,member Sep 28 15:56:11.231169 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Roles: reader,member Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35cf5a9c74e44a918e45867c6570aa11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-Tenant-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Id: default Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Domain-Name: Default Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Id: 5fac9ab7665b4f14936adea96ae22ec4 Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: X-User-Name: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: method: > Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: exception: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.232979 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: action_args: {'id': '77c8bf17-ac25-4fa7-a79d-521d43b9902c'} Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:56:11.234500 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.236159 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.237935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Returning 404 to user: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:56:11.237935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ba305ae8-1939-4acb-a3da-8c3f6cda73e1 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 404 len: 111 microversion: 2.1 time: 0.034832 Sep 28 15:56:11.237935 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 559/1112] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 15:56:11 2022] DELETE /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:56:11.242714 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:11.243406 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.compute.api [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] [instance: 77c8bf17-ac25-4fa7-a79d-521d43b9902c] Fetching instance by UUID {{(pid=127073) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 15:56:11.250499 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:11.251114 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:11.251559 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:11.252490 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Acquiring lock "a9312f5f-55a4-4294-b434-e057139feeb0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 15:56:11.252960 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 15:56:11.253380 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Lock "a9312f5f-55a4-4294-b434-e057139feeb0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 15:56:11.267771 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] HTTP exception thrown: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Request method failure captured: Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: request: GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c HTTP/1.1 Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept: application/json Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Accept-Encoding: identity Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Connection: close Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Length: 0 Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Content-Type: application/json Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Host: 10.222.0.52 Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: Openstack-System-Scope: None Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: User-Agent: python-urllib3/1.26.12 Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Auth-Token: gAAAAABjNG0G_Sr0czRGPWrgxz9htjB4vms6hb2jCXuO8xeX5kbl3SA0heL_f6BOnqtMSSkQjfw1fknGak_j1niqcrZkGJMb7Z__85lTudzRR2V8kQDAgW9OGq0hT-cx3OCtWpU4-M8_9G0lUWK1YkxP2lvuN2aVb__N-snvp8e_c3NOdcN-66I Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Id: None Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Domain-Name: None Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Identity-Status: Confirmed Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Is-Admin-Project: True Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Id: default Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Domain-Name: Default Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Project-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Role: reader,member Sep 28 15:56:11.269308 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Roles: reader,member Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35cf5a9c74e44a918e45867c6570aa11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35cf5a9c74e44a918e45867c6570aa11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Id: 35cf5a9c74e44a918e45867c6570aa11 Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-Tenant-Name: tempest-TestVolumeBootPattern-755827502 Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Id: default Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Domain-Name: Default Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Id: 5fac9ab7665b4f14936adea96ae22ec4 Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: X-User-Name: tempest-TestVolumeBootPattern-755827502-project Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: method: > Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: exception: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.271111 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: action_args: {'id': '77c8bf17-ac25-4fa7-a79d-521d43b9902c'} Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 15:56:11.271984 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. Sep 28 15:56:11.273388 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Sep 28 15:56:11.274759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Returning 404 to user: Instance 77c8bf17-ac25-4fa7-a79d-521d43b9902c could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 15:56:11.274759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-946ecb70-9edc-4fa6-8aa3-cc045830d531 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c" status: 404 len: 111 microversion: 2.1 time: 0.031929 Sep 28 15:56:11.274759 dv-cinder-859319-2-iscsi devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 554/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 15:56:11 2022] GET /compute/v2.1/servers/77c8bf17-ac25-4fa7-a79d-521d43b9902c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 15:56:12.589569 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-d4e1574f-d8ab-42b2-942e-5c81274d26b8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] Calling method '.version_select at 0x7f1154fc3ee0>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 15:56:12.615311 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-d4e1574f-d8ab-42b2-942e-5c81274d26b8 tempest-TestVolumeBootPattern-755827502 tempest-TestVolumeBootPattern-755827502-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1866724906" status: 202 len: 0 microversion: 2.1 time: 0.029361 Sep 28 15:56:12.616116 dv-cinder-859319-2-iscsi devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 560/1114] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Sep 28 15:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1866724906 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)